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SECTION  I 
INTRODUCTION 
Background 

The  Naval  Training  Equipment  Center  (NA VTRAEQUIPCEN)  has  con- 
tinually been  investigating  the  application  of  new  technologies  to  the  Navy's 
training  requirements.  As  part  of  this  program,  the  Human  Factors  Lab- 
oratory has  been  experimenting  with  speech  understanding  and  synthesis 
as  applied  to  the  training  of  controller  tasks.  The  degree  of  automation 
allowed  by  these  computer-based  speech  technologies  enables  the  develop- 
ment of  automated-adaptive  training  systems  for  Ground  Controlled  Ap- 
proch  (GCA)  controllers,  etc.  The  GCA -Controller  Training  System 
(GCA-CTS),  developed  by  NA  VTRAEQUIPCEN  and  Logicon,  was  and  con- 
tinues to  be  an  important  test  bed  for  exploring  both  the  application  of  the 
speech  technologies  to  controller-type  tasks,  and  the  specification  of  train- 
ing requirements  and  critical  functional  features  of  advanced  speech- 
technology-based  systems. 

The  next  step  in  NA  VTRAEQUIPCEN' s research  program  is  the  study 
and  development  of  an  automated  training  capability  for  air- intercept  con- 
trollers (AIC).  Not  only  is  the  AIC  vocabulary  significantly  more  complex 
than  the  GCA  vocabulary,  but  the  performance  and  learning  requirements 
of  the  AIC  are  more  involved  than  in  the  final  segments  of  Precision  Ap- 
proach Radar/GCA  (PAR-GCA).  The  automated  AIC  training  problem  thus 
represents  a significant  advance  in  both  the  application  of  the  speech  tech- 
nologies as  well  as  training  system  design. 

At  the  same  time,  the  fleet's  requirements  are  both  real  and  immedi- 
ate. AIC  training  is  currently  conducted  at  the  Fleet  Combat  Training 
Centers  in  San  Diego  (FCTCP)  and  Dam  Neck.  The  training  is  supported 
in  large  measure  by  the  Tactical  Advanced  Combat  Direction  and  Electronic 
Warfare  (TACDEW)  training  system  developed  in  the  1960s.  Modern  train- 
ing approaches  and  technologies  have,  for  the  most  part  not  impacted 
AIC  training.  The  high  cost  and  low  availability  of  live-air  training  makes 
it  even  more  difficult  to  meet  the  fleet's  readiness  requirements.  Relief 
is  required. 

Toward  that  end,  the  FCTCP  has  defined  the  requirement  for  a large 
scale  Air  Intercept  Controller/Antisubmarine  Aircraft  Controller  (AIC/ 
ASAC)  training  complex  to  be  developed  in  the  1980  time  frame.  In 
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support  of  this  effort,  the  Center  has  conducted  an  analysis  of  the  AIC  oper- 
ational responsibilities.  Results  of  the  analysis  constitute  an  evolving 
document,  of  course,  but  complete  and  accurate  descriptions  have  been 
provided  of  the  learning  objectives  and  performance  requirements  currently 
being  used  at  FCTCP.  These  represent  a good  first  step  toward  defining 
the  eventual  requirements  of  the  AIC  portion  of  the  1980  AIC/ASAC  trainer. 

To  satisfy  the  more  immediate  manpower  and  training  time  restrictions 
being  felt  at  FCTCP,  a "quick-fix"  capability  has  been  identified.  It  is 
believed  that  if  the  existing  TACDEW  operators  (pseudo  pilots)  could  be 
replaced  by  a very  limited  speech  recognition  capability,  that  some  limited 
training  can  be  conducted  and  manpower  costs  decreased.  Computer  grad- 
ing, objective  performance  measurement,  self-paced  instruction,  etc.  will 
not  be  addressed  by  the  quick  fix;  and  yet  these  and  other  instructional 
and  system  features  are  desired  for  the  later  AIC/ASAC  trainer.  NAVTRA- 
EQUIPCEN's training  research  program  can  provide  design  guidelines  and 
specifications  for  these  aspects  of  the  device. 


Purpose  of  the  Study 

Prior  to  immediate  commencement  of  design  and  implementation  ac- 
tivities, NAVTRAEQUIPCEN  has  sponsored  a short  study /planning  effort 
which  has  had  the  following  principal  goals; 

a.  Review  and  document  the  existing  task  analysis  performed  by 
FCTCP,  paying  particular  attention  to  the  AIC  "controller  model"  and  the 
AIC  vocabulary. 

b.  Specify  the  general  system  requirements  imposed  by  the  quick-fix 
solution  to  FCTCP's  needs. 

c.  Delineate  the  tasks  that  must  yet  be  accomplished  prior  to  full- 
scale  development  of  NAVTRAEQUIPCEN's  training/research  system,  and 
suggest  a management  plan  for  their  implementation. 


Overview  of  this  Report 


Logicon  reviewed  the  AIC  training  and  training  research  problems,  and 
in  support  of  the  goals  mentioned  above  has  documented  the  findings  in  this 
technical  report.  Following  this  brief  introduction,  the  report  describes 
the  current  AIC  course  structure  at  FCTCP.  One  particular  level  (level 
twelve),  is  singled  out  for  detailed  review  because  of  its  impact  on  both 
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FCTCP's  quick  fix  and  (potentially)  NAVTRAEQUIPCEN' s research  oriented 
Air  Control  Training  System  (ACTS).  This  section  also  provides  an  overview 
of  the  training  environment  provided  at  FCTCP,  focussing  on  the  AIC  inputs/ 
outputs  and  processing  associated  with  the  simulation  programs. 

Section  III  discusses  the  AIC  vocabulary,  especially  in  terms  of  the 
requirements  imposed  by  this  vocabulary  on  the  speech  recognition  tech- 
nology. The  report  then  goes  on  (in  section  IV)  to  describe  the  system 
requirements  imposed  by  the  FCTCP  quick  fix  scheme.  The  training 
tasks  that  can  be  supported  as  well  as  hardware /software  considerations 
are  discussed. 

Section  V briefly  discusses  the  AIC/ASAC  trainer,  and  section  VI  re- 
views the  requirements  of  ACTS.  The  report  concludes  with  recommended 
courses  of  action  for  both  NAVTRAEQUIPCEN  and  FCTCP. 

A secondary  consideration  in  writing  this  report  has  been  to  exclude 
any  classified  information.  All  references  to  detailed  actions  on  the  NTDS 
UYA-4  consoles,  for  example,  have  consequently  been  avoided.  The  AIC 
task  analysis  performed  by  FCTCP  is  classified  confidential,  and  yet  this 
document  provides  a wealth  of  detailed  information  which  is  only  sum- 
marized herein.  NAVTRAEQUIPCEN  is  encouraged  to  review  a copy  of 
these  task  listings  to  supplement  this  report. 
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SECTION  II 

AIC  TRAINING  AT  FCTCP 


Introduction 

The  Fleet  Combat  Training  Center,  Pacific  (FCTCP)  is  responsible 
for  providing  the  fleet  with  qualified  air  intercept  controllers.  Toward 
that  end,  they  have  established  a course,  designated  K-22 1-0027,  with  the 
stated  objective  to  "train  officers  and  senior  enlisted  to  effectively  control 
fleet  intercept  aircraft  in  combatting  hostile  airborne  threats.  " A full- 
scale  simulation  environment  supports  this  course.  The  following  subsec- 
tions describe  the  AIC  training  program  at  FCTCP. 

Entry-Level  Qualifications 

Many  students  entering  AIC  training  are  Naval  Tactical  Data  System 
(NTDS)  qvialified.  This  NTDS  training  consists  of  abrief  exposure  to  all  the 
various  responsibilities  in  the  typical  NTDS-based  Combat  Infornaation  Cen- 
ter (CIC).  The  primary  importance  of  this  training  to  the  AIC  student  is  that 
he  will  have  been  exposed  to  the  various  modes  of  NTDS  operation  and  will 
not  need  to  be  familiarized  with  its  basic  concepts.  On  those  occasions 
when  a student  has  entered  AIC  training  without  prior  NTDS  experience, 
his  subsequent  success  in  the  AIC  program  appears  to  depend  on  a number 
of  factors,  the  most  important  of  which  are  maturity  and  experience  in  the 
Navy.  Among  those  who  fail  to  complete  tlie  AIC  course,  the  lack  of  famil- 
iarity with  NTDS  plays  a significant  role.  Therefore,  the  present  intention 
is  to  establish  NTDS  qualification  as  an  entry  level  requirement  for  all 
students.  In  addition,  it  is  preferred  (though  not  a formal  requirement) 
that  all  students  entering  the  program  have  2 — 4 years  general  experience 
in  the  Navy. 

Student  Load  ^ 

I 

1 

Presently  one  AIC  class  is  started  each  week.  The  class  consists  of 
two  NTDS  students  who  start  and  progress  together  through  6 seeks  of  AIC 
training.  | 
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In  addition  to  the  2 NTDS  students,  2 students  are  also  started  each 
week  in  a "conventional”  class.  These  students  supply  the  diminishing 
demand  for  AICs  aboard  the  few  remaining  non- NTDS -equipped  ships  in 
the  fleet.  It  is  important  to  note  that  future  plans  call  for  dropping  con- 
ventional training  altogether  and  adding  these  students  to  the  NTDS  group. 
This  will  result  in  an  additional  2 NTDS  students  who  are  starting  each 
week.  The  present  study  did  not  address  "conventional"  AIC  training. 

The  AIC  training  program  is  also  responsible  for  providing  refresher 
and  supervisor  training  which  must  be  conducted  on  the  same  equipment. 
These  courses  account  for  1 to  2 students  per  week,  which  brings  the  long- 
term expected  student  load  up  to  5 to  6 students  per  week.  These  students 
are  all  trained  on  the  same  equipment  and  in  a very  similar  fashion. 

AIC  Course  Philosophy 


The  major  stepping  stone  between  previous  AIC  training  (prior  to 
January  1977)  and  the  existing  course  was  the  emphasis  on  teaching  a job 
rather  than  equipment.  The  majority  of  operators  have  traditionally  been 
taught  using  equipment  technical  manuals.  Instruction  often  consisted  of 
simple  demonstrations  to  the  student  that  indeed  if  switch  A was  thrown, 
then  A'  resulted.  One  AIC  instructor  muses  that  when  he  attended  AIC 
school  in  the  early  1960s,  all  instruction  was  essentially  presented  during 
the  first  week!  If  the  proper  button  pushing  sequences  were  learned  dur- 
ing that  time,  the  course  was  essentially  complete! 

By  comparison,  the  current  AIC  course  is  strictly  task  oriented.  This 
becomes  clear  when  the  specific  learning  objectives  are  presented  in  the 
following  subsection,  but  a specific  example  is  also  illuminating,  Conside 
the  problem  of  teaching  the  Identification  Friend  or  Foe  (IFF)  system  to  the 
controller.  Previously  this  was  taught  by  describing  the  various  switches 
(explaining  what  each  one  did)  one  row  at  a time.  If  problems  developed, 
the  instructors  dug  deeper  into  the  equipment  manuals  and  explained  the 
system  block  diagram;  trigger  pulses,  timing,  responses,  etc. 

The  current  system,  on  the  other  hand,  identifies  the  jobs  that  IFF  sup 
ports.  IFF  "experts"  found  it  difficult  to  name  them  all,  but  persistence 
resulted  in  clearly  defined  tasks.  Given  a checklist  to  set  up  the  IFF  equip 
ment,  the  following  tasks  can  be  performed: 

a.  Assist  in  tracking  friendly  aircraft  using  IFF. 

b.  Identify  an  emergency  using  IFF. 
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c.  Identify  one  friendly  aircraft  from  another  using  IFF. 

d.  Obtain  the  altitude  of  friendly  aircraft  using  IFF. 

e.  Make  a positive  identification  using  IFF. 

Each  job  is  explained;  each  step  is  explained.  The  actual  operation  of  the 
equipment  is  discussed  only  in  terms  of  its  contribution  to  the  job. 

In  addition  to  defining  the  AIC  responsibilities  in  terms  of  functional 
tasks  rather  than  equipment  operation,  the  current  AIC  course  places 
heavy  emphasis  on  proper  motivation  of  the  student.  Each  task  is  struc- 
tured to  begin  with  the  easy  and  progress  to  the  difficult.  Basic  skills  are 
taught  before  moving  on  to  the  more  complex  interactions.  Because  air 
intercept  control  has  a reputation  in  the  fleet  and  training  centers  for 
being  particularly  difficult,  the  trainee  is  too  often  too  willing  to  give  up. 

By  starting  with  the  easy  and  simple  tasks,  the  student  learns  that  he  can 
do  the  job.  By  the  time  he  has  progressed  to  the  challenging  Air  Combat 
Maneuvers  (ACM),  he  is  motivated  and  self  confident  so  that  the  learning 
experience  becomes  less  threatening. 

By  approaching  all  of  the  AIC's  responsibilities  in  these  ways,  the 
existing  AIC  course  was  developed.  The  results  have  been  rewarding. 

The  instructors  feel  less  harried  and  the  students  are  better  trained. 

Course  Structure 

The  first  three  weeks  of  the  AIC  course  consist  of  classroom  instruc- 
tion and  synthetic  (simulated)  air  control.  The  second  three  weeks  consist 
of  actual  air  control  using  real  aircraft  and  pilots  engaged  in  their  own 
training  exercises  out  of  nearby  Miramar  NAS.  Synthetic  training  has  been 
the  primary  interest  in  this  present  study. 

As  just  described,  the  course  is  designed  to  gradually  introduce  the 
student  to  the  jobs  of  an  AIC.  Thirteen  levels  are  identified  in  the  syn- 
thetic portion  of  the  course,  progressing  from  easy  to  hard,  simple  to 
complex.  (Three  additional  levels  concern  "live"  training.  ) Each  level 
is  designed  with  a specific  objective  (or  objectives)  in  mind,  and  the  student 
is  expected  to  complete  each  learning  objective  before  proceeding  to  the  next 
level. 

Levels  1 — 6 cover  the  intercept  phase;  Idvels  7—11  the  engagement 
phase;  and  levels  12  and  13  prepare  the  student  for  "live"  air  control  by 
covering  set-ups  and  tanker  join-ups.  The  content  of  each  level  is  described 
in  detail  in  the  following  paragraphs,  and  sunamarized  in  table  1. 


i 
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TABLE  1,  SUMMARY  OF  AIC  COURSE  LEVELS 

Level  Content 

1 Range  and  bearing  from  ownship  to  target 

2 Target  track  and  speed 

3 Jinking  — drastic  changes  in  track,  speed,  or  altitude 

4 Range  and  bearing  from  interceptor  to  target 

4a  NTDS  failure  — perform  above  without  NTDS  support 

5 Update  TAO/SWC.  Respond  to  "Contact,"  "Judy,"  "Lost 
Contact,  " "Stranger"  calls 

6 Splitting  bogeys 

7 Composition  and  formations 

8 ACM 

9 Missions  for  CAPs  other  than  intercepts  and  engagements 

10  Jamming  and  interference 

1 1 F-  14  one-way  data  link 

12  The  training  environment;  set  ups,  breakaways,  and  check-in 
procedures 

13  Friendly /tanker  join  ups 
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3.  Interpret  magnetic  variation. 

4.  Enter  air  target. 

5.  Interpret  magnetic  bearing  and  range. 

6.  Observe  rules  for  clarity  on  radio /telephone  (R/T)  circuits. 

7.  Track  air  target. 

Level  Two 

a.  Terminal  Objective:  Transmit  target  track  and  ground  speed. 

b.  Standard;  Track  ±10  degrees  and  speed  ±0.  1 Mach,  within  one 
minute  of  detection. 

c.  Enabling  Objectives:  Interpret  target  track  and  ground  speed. 
Level  Three 

a.  Terminal  Objectives: 

1.  Transmit  target  track  jink  direction.  (A  jink  is  a drastic 
change  in  track,  speed  or  altitude  - ) 

2.  Transmit  updated  target  track. 

3.  Transmit  target  ground  speed  jink,  increase/decrease. 

4.  Transmit  updated  ground  speed. 

5.  Obtain  target  altitude. 

6.  Transmit  target  altitude. 

b.  Standards: 

1.  Track  jink  direction;  correct  direction  (left/ right)  within  one 
minute  of  jink. 

2.  Update  track;  within  1-1/2  minutes,  ±10  degrees. 

3.  Ground  speed  jink;  increase/decrease  within  one  minute. 
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4.  Updated  ground  speed:  within  1-1/2  minutes,  ±0.  1 Mach. 

5.  Altitude  request:  within  1 minute  of  target  detection  and  1 
minute  of  ground  speed  jink. 

6.  Transmit  target  altitude:  within  30  seconds  upon  receipt, 
c.  Enabling  Objectives: 

1.  Maintain  a track  history  of  target's  track. 

2.  Recognize  a track  jink. 

3.  Interpret  magnetic  track. 

4.  Recognize  ground  speed  jink. 

5.  Request  target  altitude  update. 

6.  Enter  new  altitude  as  required. 

Level  Four 

a.  Terminal  Objectives: 

1.  Using  Link  4A  with  voice  (R/T)  as  a backup,  transmit  mag- 
netic bearing  and  range  to  a target  from  an  interceptor  (CAP  — Combat 
Air  Patrol). 

2,  Transmit  "in-the -dark"  calls,  i.  e.  , when  radar  video  fades. 

b.  Standards: 

1.  Transmit  magnetic  bearing  and  range:  from  the  CAP  to  the 
target,  8 out  of  every  10  sweeps,  accurate  ±2  degrees  cuid  ±1  mile. 

2.  Call  in  the  dark:  within  2 sweeps  of  the  fade. 

c.  Enabling  Objectives: 

1.  Enter  interceptor. 

2.  Track  interceptor, 

3.  Determine  magnetic  bearing  and  range  from  CAP  to  target, 

4.  Maintain  smallest  range  scale  for  tracking  CAP  and  target. 

5.  Transmit  in-the -dark  calls. 


I 
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Level  Four  a 

a.  Terminal  Objectives; 

1.  Transmit  an  estimated  magnetic  bearing  and  range  from  a 
CAP  to  a target  without  the  use  of  an  NTDS  program. 

2.  Transmit  target  track  and  ground  speed  without  the  use  of  an 
NTDS  program. 

b.  Standards; 

1.  Magnetic  bearing  and  range;  from  the  CAP  to  the  target  8 out 
of  10  sweeps,  accurate  ±6  degrees  and  ±6  miles. 

2.  Track  and  ground  speed;  ±10  degrees  and  0.  2 Mach  within 
1-1/2  minutes  of  detection. 

c.  Enabling  Objectives; 

1.  Adjust  plotting  head  intensity. 

2.  Align  plotting  head  for  magnetic  bearing. 

3.  Determine  magnetic  bearing. 

4.  Determine  target  tracks  and  ground  speed. 

5.  Determine  jinks. 

Level  Five 

a.  Terminal  Objectives; 

1.  Update  the  air  picture  to  TAO/SWC  (Tactical  Action  Officer/ 

Ship's  Weapon  Coordinator). 

2.  Relay  orders  from  TAO/SWC  to  CAP  via  Link  4A  with  voice 

back  up. 

3.  Respond  to  "Contact,"  "Judy,"  "Lost  Contact"  calls. 

4.  Call  "Strangers"  to  aircraft. 

b.  Standards; 

1.  Inform  SWC/TAO  of  CAP  call  and  type  of  interceptor  within 
1-1/2  minutes  after  receipt  by  voice  communications. 
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2.  Inform  SWC/TAO  of  interceptor  state  and  status  within 
2 minutes  after  receipt. 

3.  Relay  engagement  orders  from  TAO/SWC  within  30  seconds 
of  receipt. 

4.  Determine  probability  of  intercept  9 out  of  10  times. 

5.  Respond  to  "Contact,  " "Judy,  " "Lost  Contact"  calls  within 
5 seconds  of  the  time  received. 

6.  Call  "Strangers"  to  aircraft  100  percent  of  time, 
c.  Enabling  Objectives; 


1.  Enter  CAP  type  and  Selective  Identification  Feature  (SIF). 

2.  Enter  CAP  state. 

3.  Relay  engagement  orders  from  SWC/TAO. 

4.  Interpret  progress  of  intercept. 


Level  Six 

Introducing  splitting  bogey.  Call  splits  and  recognize  the  priority 
threat;  track  more  than  two  aircraft. 

a.  Terminal  Objectives: 

1.  Transmit  target  splits  (two  or  more  radar  returns  splitting 
from  a single  return)  via  Link  4A  with  voice  backup. 

2.  Maintain  track  on  more  than  two  aircraft. 

b.  Standards: 

1.  Transmit  target  splits; 

a)  Report  within  20  seconds  of  splits. 

b)  Report  bogfty  dope  on  the  most  threatening  bogey  8 out 
of  10  sweeps. 

c)  Report  the  other  aircraft  upon  request  within  six  seconds. 

d)  Four  out  of  five  transmissions  must  be  interpreted 
correctly. 
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2.  Maintain  track  on  more  than  two  aircraft;  update  the  track 
for  each  aircraft  at  least  8 out  of  10  sweeps. 

c.  Enabling  Objectives: 

1.  Direct  target  splits. 

2.  Determine  most  threatening  target. 

3.  Call  bogey  dope  on  additional  targets  on  request. 

Level  Seven 

a.  Terminal  Objectives: 

1.  Transmit  bogey  composition. 

2.  Transmit  bogey  formation. 

b.  Standards: 

1.  Transmit  bogey  composition;  reported  within  30  seconds, 
accurate  9 out  of  10  times. 

2.  Transmit  bogey  formation;  reported  within  45  seconds, 
accurate  9 out  of  10  times. 

c.  Enabling  Objectives; 

1.  Obtain  bogey  composition. 

2.  Interpret  bogey  composition. 

3.  Obtain  bogey  formation. 

4.  Interpret  bogey  formation. 

Level  Eight 

a.  Terminal  Objectives; 

1.  Update  TAO/SWC  on  progress  of  engagement. 

2.  Transmit  time  in  fight. 

3.  Transmit  aircraft  out  of  fight. 
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b.  Standards: 


1. 

progress  to 


Update  TAO/SWC  on  progress  of  engagement:  report 
TAO  9 out  of  10  times.  Interpret: 


accurate 


"BURNER" 

"VISUAL" 

"TALLY  HO" 

"EYEBALL" 

"CLEAR" 

"ENGAGED" 

"FREE" 

"OFF" 

"IN" 

"PRESS  HIM" 
"UNLOAD" 
"ACM  GUARD" 


"DRAG  HIM" 

"SWITCH" 

"BREAK  LEFT/RIGHT" 
"REVERSE" 

"COME  BACK" 

"PITCH  BACK" 
"EXTEND" 

"PADLOCK" 

"KNOCK  IT  OFF" 

"BUG  OUT" 

"LAST  DITCH" 


2.  Transmit  time  in  fight;  accuracy +5  seconds. 

3.  Transmit  aircraft  out  of  the  fight:  separation  from  a merged 
plot  reported  within  5 seconds. 

c.  Enabling  Objectives; 

1.  Interpret  ACM  conrumunications. 

2.  Time  the  engagement. 

3.  Detect  splits  out  of  a fight. 

Level  Nine 


a.  Terminal  Objectives; 

1.  Track  synthetic  video  using  overlapping  live  radar. 

2.  Track  friendly  aircraft  with  the  assistance  of  IFF. 

3.  Distinguish  one  friendly  aircraft  from  another  using  IFF. 

4.  Recommend  heading  to  maintain  a specific  track. 

5.  Transmit  information  on  weather  points, 

6.  Relay  pilot  weather  reports,  case  recoveries  and  flight 
conditions. 
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7.  Transmit  stranger  information. 

8.  Identify  an  emergency  response. 

9.  Transmit  required  information  to  assist  in  emergencies. 

10.  Transmit  required  information  to  assist  in  search  and  rescue. 

b.  Standards: 


1.  Track  synthetic  video  using  overlapping  live  radar:  maintain 
track  of  CAP  and  strangers  8 out  of  10  sweeps. 


2.  Track  friendly  aircraft  with  the  assistance  of  IFF:  IFF  equip- 
ment must  be  set  up  correctly  prior  to  any  flight. 

3.  Identify  one  friendly  aircraft  from  another  using  IFF: 

a)  Transmit  "Squawk  Ident"  if  PIF  is  unknown. 

b)  Reset  equipment  for  tracking. 

4.  Recommend  heading  to  maintain  a specific  track:  accuracy 
±5  degrees. 


5.  Transmit  information  on  weather  points:  accuracy  ±5  degrees 
±2  miles. 

6.  Relay  pilot  weather  reports,  case  recoveries  and  flight  con- 
ditions: accuracy  100  percent. 


7.  Transmit  stranger  information: 

a)  All  strangers  must  be  reported  prior  to  5 miles  from 
interceptor  100  percent  of  the  time. 

b)  Accuracy  ±5  degrees  ±2  miles. 

8.  Identify  an  emergency  response:  accuracy  100  percent. 

9.  Transmit  required  information  to  assist  in  emergencies 
100  percent. 

10.  Transmit  required  information  to  assist  in  search  and  rescue 
100  percent. 
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c.  Enabling  Objectives: 

1.  Determine  aircraft's  mission. 

2.  Plot  a geographic  picture  on  a radar  repeater, 

3.  Determine  offset  from  desired  track. 

4.  Compensate  for  offset  (winds  aloft). 

5.  Interpret  pilot  weather  reports,  case  recoveries  and  flight 
conditions. 

6.  Detect  strangers. 

7.  Plot  strangers. 

8.  Estimate  magnetic  bearing  and  range  to  a stranger. 

9.  Detect  an  emergency. 

10.  Transmit  search  and  rescue  information  on  down  aircrews. 
Level  Ten 

a.  Terminal  Objectives; 

1.  Provide  assistance  to  aircrews  while  experiencing  radar 

jamming. 

2.  Provide  assistance  to  aircrews  while  experiencing  radio 
jamming. 

b.  Standards: 

1.  Provide  assistance  to  aircrews  while  experiencing  radar 

jamming: 

a)  Jamming  — able  to  complete  mission:  transmit  bearing 
and  range  to  weather  points.  Accuracy  ±5  degrees,  ±2  miles. 

b)  Jamming  — unable  to  complete  mission:  transmit  bearing 
and  range  to  weather  points.  Accuracy  ±10  degrees,  ±6  miles. 

c)  Provide  BA  RCA  P with  bearing  and  range  to  jammer. 
Accuracy  ±5  degrees  and  ±5  miles. 
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2.  (Classified) 

c.  Enabling  Objectives;  (Classified) 


Level  Eleven 


a.  Terminal  Objectives; 


1.  Up  date  the  aircrew  of  the  F-14  interceptor  via  one  way  data 


2.  Relay  force  and  TAO  orders  concerning  CAP/missile 
coordination. 

3.  Transmit  MIG/Surface-to-Air  Missile  (MIG/SAM)  warnings. 

4.  Recommend  return  to  force  headings. 

b.  Standards; 

1.  Establish  one-way  link  with  section  of  F-14s;  within  1 minute 
after  check  in, 

2.  Up  link  radar  track  information  to  F-14s;  within  30  seconds 
after  detection. 

3.  Relay  force  orders  and  TAO  orders  concerning  Combat  Air 
Patrol/Surface-to-Air  Missile  coordination;  with  100  percent  accuracy. 

4.  Transmit  SAM/MIG  trap  warnings;  within  5 seconds  of  receipt. 

5.  Recommend  return  to  force  headings;  ±5  degrees 

c.  Enabling  Objectives; 

1.  Establish  one-way  link  with  a section  of  F-14s. 

2.  Up  link  geographical  data  to  a section  of  F-14s. 

3.  Up  link  radar  track  information  to  a section  of  F-14s. 

4.  Relay  force  and  TAO  orders  concerning  CAP/Missile  coord- 
ination both  by  data  link  and  voice. 
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5.  Enter  MIG/SAM  traps  in  program. 

6.  Transmit  MIG/SAM  traps. 

Transmit  return  to  force  headings. 

Level  Twelve 

a.  Terminal  Objectives; 

1.  Pick  up  assigned  aircraft. 

2.  Transmit  headings  for  training  set-ups  via  Link  4A  with  voice 

backup. 

3.  Transmit  headings  for  area  control  via  Link  4A  with  voice 

backup. 

b.  Standards: 

1.  Locate  aircraft  using  IFF  and/or  Tactical  Air  Navigation 
(TACAN):  within  1 minute  after  communications  established  (100  percent 
of  the  time). 

2.  Provide  headings  to  station  or  area:  within  30  seconds  after 
locating  aircraft. 

3.  Transmit  headings  via  Link  4A  with  voice  backup:  with  an 
accuracy  of  ±10  degrees  within  5 miles  of  desired  range  of  separation. 

4.  Transmit  headings  for  breakaways,  and  area  control:  witii  an 
accuracy  to  remain  in  the  area  at  all  times. 

c.  Enabling  Objectives; 

1.  Locate  aircraft. 

2.  Determine  lost  communications. 

3.  Provide  headings  to  stay  in  the  area. 

4.  Planning  bearing,  target  aspect  angle,  angles  off,  and  track 
crossing  angle. 
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5.  Plot  fighter  heading,  bogey  heading,  and  reciprocal. 

6.  Determine  the  area  of  the  intercept. 

7.  Turn  bogey. 

8.  Turn  fighter. 

9.  Determine  headings  for  breakaway  and  area  control. 

Level  Thirteen 

a.  Terminal  Objectives: 

1.  Assist  in  an  aircraft  rendezvous. 

2.  Relay  state  and  status  reports. 

b.  Standards:  Recommend  headings  ±5  degrees  within  1 minute  of 
request. 

c.  Enabling  Objectives: 

1.  Locate  tanker  or  friendly  aircraft  for  rendezvous. 

2.  Recommend  headings  to  both  aircraft. 

3.  Ensure  altitudes  are  known. 

4.  If  a tanker  determine: 

a)  Condition  of  package. 

b)  Amount  of  give  away  before  and  after  refueling. 

c)  If  not  Navy,  is  tanker  basket  capable? 

5.  Interpret  state  and  status  reports. 

A Typical  Scenario 


Throughout  this  study,  level  twelve  has  been  the  subject  of  particularly 
close  study  because  of  its  impact  on  both  the  FCTCP  quick  fix  as  well  as 
on  the  potential  design  of  ACTS.  Recall  that  level  twelve  covers  setups 
(establishing  various  aspect  angles  to  support  aircrew  training),  break- 
aways (recommended  headings  to  remain  in  an  assigned  area),  and  check 
in  procedures.  Moreover,  all  skills  gained  in  the  intercept  phase  (levels 
one  through  six)  as  well  as  emergencies,  area  control  and  stranger  reports, 
are  practiced  during  this  level. 

During  level  twelve  the  student  communicates  with  a pseudo  pilot 
who  is  interacting  directly  with  the  training  system,  e.  g.  , TACDEW. 

The  pseudo  pilot  is  typically  controlling  two  "aircraft.  " 
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The  detailed  requirements  of  level  twelve  are  fully  documented  in 
the  classified  task  listings  associated  with  this  level.  Table  Z presents 
a typical  sequence  of  events  during  the  training  session. 

Note  that  in  level  twelve,  as  in  all  the  AIC  training,  the  student  must 
acquire  verbal,  cognitive,  and  motor  skills.  The  verbal  skills  required 
are  amply  demonstrated  in  table  2.  As  an  example  of  cognitive  skills,  con- 
sider the  problem  of  determining  the  proper  "planning  bearing"  (the  bear- 
ing to  the  bogey  taking  into  consideration  bearing  drift),  the  "target  aspect 
angle"  (the  angle  from  the  bogey's  track  to  bearing-to-CAP),  and  the  "angle 
off"  (the  angle  from  the  CAP'S  heading  to  bearing-to-bogey).  The  student 
is  then  required  (while  aircraft  are  opening  out)  to; 


a.  Determine  the  planning  bearing. 

b.  Determine  the  area  the  intercept  should  occur. 

c.  Add/subtract  angle  off  from  planning  bearing. 

d.  Add  the  target  aspect  angle  in  the  other  direction  from  the  plan- 
ning bearing  and  mark  it  (R)  for  the  bogey  reciprocal. 

e.  Find  reciprocal  of  (R)  to  determine  bogey  heading. 


To  appreciate  the  level  of  motor  skill  development  that  must  simultaneously 
be  acquired,  consider  the  following  sequence  that  must  be  performed  to 
report  a stranger; 


a.  Student  sees  stranger  aircraft. 

b.  Student  depresses  Sequence  button  and  sequences  to  CAP. 

c.  Student  depresses  Ball  Tab  button,  enabling  ball  tab. 

d.  Utilizing  ball-tab  roller,  student  rolls  ball  tab  to  position  of 
stranger. 


e. 

Student 

f. 

Student 

g- 

Student 

h. 

Student 

L. 

Student 

j- 

Student 

depresses  a variable  action  button, 
reads  bearing  and  range  from  console, 
observes  direction  of  stranger's  track, 
depresses  radio  transmitter  foot  pedal, 
transmits  stranger  position  and  track  to  CAP. 
releases  foot  pedal. 
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TABLE  2.  SAMPLE  SCENARIO  FOR  LEVEL  TWELVE  MISSION. 

Sample  Voice  Messages 

Ruth,  this  is  Skyking  302  and  303  up 
for  your  control. 

Roger.  Mark  your  TACAN. 

302  (is  on  the)  275  (at)  20. 

Roger.  Radar  contact.  Port  240  for 
the  area. 

Roger. 

302,  say  lost  communications  inten- 
tions, over. 

Pilot  This  is  302.  Point  Whiskey,  twenty, 
port  orbit. 

AIC  302,  Tango  1,  Tango  2 hot.  Recom- 

mend rendezvouz  Point  Sierra. 

Pilot  Roger. 

3.  Mode  3 IFF  assign-  AIC  302  squawk  5741. 

ment.  303  squawk  5742. 

Pilots  302  roger,  out. 

303  roger,  out. 

4.  Unidentified,  friendly  AIC 

stranger. 

Pilot 

5.  Practice  separation.  AIC 

Pilot 
AIC 
Pilot 

6.  Turn  for  intercept.  AIC 

Pilot 
AIC 
Pilot 


302,  stranger,  320,  eight,  heading 
south,  altitude  eighteen  thousand. 

302,  tally  stranger. 

303  (detach)  starboard  340,  over. 
303  roger,  340  out. 

302  port  160  (for  separation). 

302,  l60  roger. 

303  port  160  as  bogey,  over. 

303  roger  160. 

302  starboard  340  for  bogey. 

302  roger,  340. 


Event 


Voice 

Source 


1.  Two  aircraft  enroute 
from  Miramar  to  training 
area  appear  on  radar, 
approximately  270  de- 
grees at  15  miles,  track- 
ing 26C  degrees  speed 
0.6.  Communications 
established. 

2.  Establish  lost  com- 
munications procedure. 


Pilot 


Pilot 


Pilot 
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TABLE  2.  SAMPLE  SCENARIO  FOR  LEVEL  TWELVE  MISSION  (Cont). 


Event 

Voice 

Source 

Sample  Voice  Messages 

7.  Fighter  makes  con- 

Pilot 

302  has  a contact  340,  twenty-seven. 

tact  with  bogey 

AIC 

That  is  your  bogey.  Tracking  160. 

8.  Lock-on. 

Pilot 

302  Judy. 

9.  Lost  contact 

Pilot 

Lost  contact. 

AIC 

302  bogey  340,  t^venty. 

302  bogey  tracking  160  speed  0.6. 

302  bogey  altitude  twenty  two  thousand 
Range  and  hearing  messages  continue 
until  contact  or  at  pilot's  request. 

10,  After  contact,  lock- 

Pilot 

Fox  2,  breakaway. 

on  and  missile  launch 

AIC 

302  breakaway  330. 

Pilot 

Roger. 

11.  Advise  bogey  of 

AIC 

303  continue  I6O. 

breakaway  heading  for 
separation. 

Pilot 

Roger. 

12.  State  report 

AIC 

302  what  state? 

Pilot 

302  eight  point  five. 

AIC 

303  what  state? 

Pilot 

303  tiger. 

13.  Cancel  order;  etc. 

AIC 

Disregard. 

14.  Garbled  transmission 

AIC 

Say  again. 

15.  Increase  turn  rate 
from  30/sec  to  6o/sec. 

AIC 

302  tighten  turn. 

16.  Contact  is  not  bogey; 
etc. 

AIC 

302  negative,  your  bogey  340,  14. 

17.  Hold  in  port  turn  at 
fixed  point. 

AIC 

303  anchor  port. 
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The  AIC  training  problem  is  clearly  a varied  and  complex  one.  This 
fact  must  be  kept  in  mind  during  the  subsequent  discussions  of  the  various 
training  systems:  the  FCTCP  "quick-fix,  " the  AIC/ASAC  Trainer,  and 
ACTS. 

Training  Facilities'^ ) 

The  training  environment  for  the  AIC  course  described  in  the  proceed- 
ing subsections  is  provided  by: 

a.  Mockups  of  the  AIC  Centers  aboard  a typical  carrier  or  Naval  Air 
Station. 

b.  An  NTDS  program,  and  related  equipment. 

c.  An  environment  simulation  program,  and  related  equipment.  Three 
principal  programs  are  available:  TACDEW,  the  Master  Simulation  Pro- 
gram (MSP),  and  the  AIC  Simulation  Program  (ASP). 

The  following  paragraphs  describe  these  facilities  in  greater  detail.  See 
Figure  1. 

The  Mockups  — Two  mockups  are  dedicated  to  AIC  training  at  FCTCP. 
One  mockup  is  used  principally  for  synthetic  training  and  contains  ten  NTDS 
console  positions.  The  other  mockup  is  used  principally  for  live  training, 
and  contains  6 NTDS  positions  as  well  as  10  "conventional"  stations.  Be- 
cause of  the  switching  capabilities  at  FCTCP,  however,  any  console  can 
receive  either  simulated  radar  video,  real  radar  video,  or  a combination 
of  both.  Each  station  includes  a radio  phone  unit  (RPU)  for  communication 
with  other  AICs,  with  the  TAO/SWC,  and  with  the  pilots  (real  or  pseudo). 
The  instructors  can  monitor  the  RPU  from  a variety  of  locations. 


Note  1.  Only  simulated  (synthetic)  training  facilities  are  discussed  here. 
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Figure  1.  AIC  Training  Environment. 

The  NTDS  Program(^)  — AIC  training  is  supported  by  a reduced  capa- 
bility NTDS  Model  4 carrier  program.  The  program  is  strictly  operational, 
in  the  sense  that  it  consists  solely  of  modules  used  in  the  operational  (ship- 
board) systems.  The  software  is  not  modified  for  the  training  environment 
in  any  way. 

The  Simulation  Programs  — Three  simulation  programs  are  available 
to  the  AIC  instructors  to  support  their  training  mission.  Each  of  these  vv'as 
originally  developed  by  Logicon,  though  Fleet  Combat  Direction  Support 
System  Activity  (FCDSSA)  has  maintained  and  (presumably)  modified  the 
programs  over  the  past  few  years. 

TACDEW  — The  Tactical  Advanced  Combat  Direction  and  Electronic 
Warfare  (TACDEW)  training  system  provides  the  most  capability,  and  is 
the  primary  simulation  program  currently  used  to  support  AIC  training. 


Note  2.  If  the  reader  is  not  familiar  with  NTDS  operation,  he  is  encouraged 
to  refer  to  the  (classified)  documentation. 
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TACDEW  is  a multicomputer  system  that  simultaneously  provides  simulated 
environments  for  various  training  missions  (Carrier  Controlled  Approach 
(CCA),  Air  Intercept  C ontroller  (AIC),  Antisubmarine  Warfare  (ASW), 
Electronic  Warfare  (EW),  etc.). 

The  heart  of  the  TACDEW  system  is  a simulation  program  which 
accepts  tape  inputs  that  specify  the  scenario  for  a pre-planned  exer- 
cise. This  scenario  contains  ship,  submarine,  and  aircraft  specifications 
(including  location,  speed,  heading,  designation,  fuel  load,  weapons,  and 
sensors)  and  specification  of  environmental  parameters  such  as  map  area, 
current,  and  wind.  Any  of  the  scenario  parameters  can  be  time  tagged  to 
, give  new  values  at  present  times  unless  overridden  by  training  instructor 

actions  taken  in  the  Problem  Control  and  Evaluation  (PClvE)  room. 

i The  simulation  program  supplies  the  environment  and  sensor  stimuli 

[ to  mockups.  This  may  take  the  form  of  radar  presentation,  sonar  reports, 

ships'  sensors,  or  voice  links.  The  students  in  the  mockups  react  to  this 
information;  their  responses  in  turn  are  received  by  the  instructors  in  the 
PC«<E  room  and  transmitted  to  the  program  which  then  alters  the 
environment. 

The  problem  control  personnel  in  the  PC)i.iE  room  not  only  act  as  the 
second  half  of  voice  links  and  enter  student  responses  into  the  computer, 
but  also  monitor  and  control  the  progress  and  environment  of  the  exercise. 
They  can  add  or  delete  ships,  submarines,  or  aircraft;  alter  fuel,  sensor, 
or  weapons  load  of  any  vehicle;  alter  probabilities  of  detection,  lock-on, 
and  kill;  or  change  the  sensor  capabilities  on  any  vehicle. 

MSP  (AICOC)  - The  AIC  One-Computer  system,  was  developed  to  pro- 
vide an  AIC  training  capability  without  tying  up  the  personnel  and  equipment 
necessary  to  operate  the  four-  or  five-computer  TACDEW  system. 

The  MSP  program  is  a modification  of  tlie  large  TACDEW  and  contains 
all  the  target  commands  from  the  large  system  applicable  to  non  data- 
j link  AIC  training.  There  are  some  limitations  as  to  the  number  and  type 

I of  targets.  These  restrictions  primarily  concern  the  exercise  author. 

“ Further,  because  the  primary  TACDEW  system  exercise  control  device, 

1 the  UYA-4  Data  Utilization  (DU)  Display  Console,  is  not  used  with  this 

: system,  the  system  operating  procedures  are  quite  different.  The  func- 

tions performed  by  the  DU  console  in  the  large  TACDEW  system  are  either 
not  available  in  the  MSP  system  or  are  performed  at  the  computer  console. 
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Tables  3 and  4 show  the  commands  available  to  the  instructors  and 
pseudo  pilots  using  the  MSP.  Figures  2 and  3,  and  table  5 demonstrate  the 
outputs  associated  with  AlC  training.  These  inputs  and  outputs  are  facili- 
tated by  a CRT  Target  Control  Subsystem,  Device  15G17. 

ASP  — A requirement  was  identified  to  support  synthetic  AIC  training 
using  Link-4A  equipped  aircraft.  This  program,  known  as  the  ASP  (Air 
Control  Training  System  Simulation  Program)  is  also  a one-computer  off- 
shoot from  the  larger  TACDEW  system,  but  differs  significantly  from  the 
MSP  (AICOC).  Figure  4 is  a block  diagram  of  the  system  configuration. 
Notice  that  both  the  student  and  instructors  utilize  UYA-4  display  consoles. 
This  heavy  requirement  on  the  consoles,  together  with  complex  instructor 
interactions  with  the  program,  have  resulted  in  the  rare  utilization  of  the 
ASP. 

AIC  Command  Decoding  — To  gain  an  appreciation  for  the  level  of 
sophistication  required  of  the  simulation  programs  (TACDEW,  MSP,  or 
ASP),  one  need  only  review  the  AIC  Command  Decoding  modules  of  these 
systems.  These  modules  provide  the  "pilot  model"  and  simulate  the  AIC 
environment  by: 

a.  Interpreting  the  air  controller  messages  that  are  exclusive  to  AIC 
(the  Basic  Command  Decoder  interprets  the  other  messages). 

b.  Generating  replies  that  a pilot  would  make  during  the  course  of 
an  intercept. 

c.  Computing  and  executing  heading,  speed,  and  altitude  changes  that 
the  pilot  would  make  without  the  direction  of  the  air  controller. 

d.  Generating  other  functions  that  add  to  the  realism  of  the  AIC/ 
Anti-Air  Warfare  (AAW)  exercise  (probability  of  detection,  probability  of 
kill,  etc.  ). 

AIC  Messages  — The  messages  which  the  AIC  module  receives  and  de- 
codes are  the  following: 

a.  "Vector  for  Bogey.  " This  is  the  first  command  given  to  an  inter- 
ceptor at  the  beginning  of  an  intercept.  It  is  the  same  as  a vector  command 
except  that  it  is  done  at  the  maximum  turn  rate. 

b.  "Speed"  as  desired. 

c.  "Angels.  " Altitude  as  desired. 
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TABLE  4.  AIC  COMMANDS. 


Entry  Cedr  Profrnm  R««ponir 


Mo4i/yin(  0«U 


Mnnninf 


BA 

BOGEY  ALTITUDE- 

Altitudr  in  (t  h 1000  <00.961 

Civm  bogey'a  altitude  to  interceptor 

BB 

BOGEY  BRNC-  RNC- 

Bnnrtng  (00-)60>.  rnngr  in 
rndnr  miUr  <000-999) 
rvquirnd. 

Civea  bogey'a  poaition  to  the  interceptor. 

BH 

BOGEY  HEADING- 

(000- J60)  required. 

Civea  bogey'a  Heading  to  imorcoptor. 

BK 

BOGEY  SPEED  (KNOTS)- 

Knot#  <000-999)  required. 

Givea  bogay'a  apeed  tn  knota  to  th*  interceptor. 

PM 

BOGEY  SPEED  (MACH)- 

Mnch  (0.  00-%.  00)  rnquirrd. 

Givaa  bogey'a  apeed  in  macha  to  the  interceptor. 

BJ 

BOGEY  JINXING 

Non*  p«rmitt«d. 

Tell  interceptor  that  bogey  la  jinxing. 

BV 

BOGEY  VECTOR 

Heading  (000-360)  required. 

Turn  to  the  indicated  heading. 

R 

REPORT  BOGEY  ALT 

None  permitted. 

Report  bogey'a  altitude. 

KA^. 

SPECIAL  ANCLE  OFF-L-DEC* 
RNC* 

Angle  <00-90),  range  in 
radar  mile*  (000-999) 
required. 

Civea  bogay'a  poaition  relative  to  interceptor. 

KAR 

SPZCIAI,  ANCLE  OFF -R -DEC- 
RNC- 

Angie  (00-90).  range  in 
radar  miiet  (000-999) 
required. 

Give#  bogey'a  poaition  relative  to  interceptor. 

KJ 

SPECIAL  JUDY 

None  permitted. 

launch  an  attack. 

KK 

SPECIAL  SKIP  IT 

None  permitted. 

Braak  off  the  intercept. 

KT 

SPECIAL  CONFIRM  TARGET - 
BRNC*  RNC« 

Bearing  (000-360).  range  in 
radar  mile*  (000-999) 
required. 

Requaata  the  pilot  to  confirm  that  he  ia  attacking 
the  correct  target. 

KCC 

5PECUL  CONTACT  CON- 
FIRMED* 

Contact  number  0-3) 
optional. 

Confirm#  that  the  contact  la  the  controlled  track'a 
bogey 

KCN 

SPECIAL  CONTACT  NEGATE 

None  permitted. 

Indicatca  to  the  pilot  that  tha  contact  he  reported 
ia  not  hia  bogey. 

KO 

SPECIAL  ORBIT 

None  permitted. 

Orbit. 

K5 

SPECIAL  STEER-BRNC* 

RNC« 

Bearing  (000-360).  range  in 
radar  mi)e*  (000-999) 
required. 

Fly  to  the  poaition  indicated. 

KH 

SPECIAL  STEER  HOMEPLATE 

None  permitted. 

Fly  to  homeplate. 

K1 

SPECIAL  ID  RUN 

None  permitted. 

Requeeta  the  pilot  to  identify  the  bogey  viaually. 

KW 

SPECIAL  NEGATE  ID 

None  permitted 

Pilot  ia  to  Ignore  the  prevloua  ID  RUN  requeat. 

KR 

SPECIAL  REPOS  BRC  (DLRP)> 
RNC  (OLRPP 

Bearing  (000-360)  and  range 
(000-999)  mOea  irom  DLRP 
are  required. 

Repoaittena  the  target  to  the  indicated  location. 

KP 

SPECIAL  HOMEPLATE  STl* 

STl  of  homeplate  required 

Aaaign  a Komcplata  to  the  target  under  cloae 
coni  rol. 

KM 

SPECIAL  INC PTR  L.  O.  RNC* 
SRCH  RNC- 

Lock  on  range  (000*999) 
mile#  and  aaarch  range 

tional.  I(  none  given, 
atandard  rangek  (or  that 

Make  the  target  under  cloae  control  an 
interceptor 

KD 

SPECIAL  ANCLE  OFF  DATA 
STI- 

STl  of  the  track  to  which 
the  angle  off  data  la 
requeated,  ia  required 

Print  angle  off  and  range  Irom  the  track  in 
dote  control  to  any  other  track  Refer  to 

Section  6 lor  the  format  of  thia  meaaage. 
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Figure  2.  Main  Display. 
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Figure  3.  Sample  Track  Information  Section  of  Main  Display. 


TABLE  5.  TRACK  STATUS  MESSAGES  (AlC  TARGETS). 
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TABLE  5.  TRACK  STATUS  MESSAGES  (AlC  TARGETS)  (Cont). 
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Figure  4.  AIC  Simulation  Program  (ASP)  Configuration 
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d.  "Angle  Off  and  Distance.  " This  rarely  used  message  from  the  air 
controller  gives  the  pilot  the  location  of  the  bogey  in  degrees  left  or  right 
of  the  interceptor's  nose  and  the  distance  in  radar  miles.  This  message 
is  given  correctly  only  when  the  interceptor  is  not  turning. 

f.  "Contact  Confirmed  (Your  Bogey).  " This  message  from  the  air 
controller  is  given  to  the  pilot  when  they  agree  on  which  of  the  contacts  on 
the  pilot's  radar  is  his  bogey. 

g.  "Contact  Negated  (Not  Your  Bogey).  " A message  from  the  air 
controller  to  the  pilot  indicating  that  the  contact  the  pilot  reported  is  not 
his  bogey. 

h.  "Skip  It.  " A message  from  the  air  controller  to  the  pilot  to  break 
off  the  intercept. 

i.  "Judy.  " A message  from  the  pilot  to  the  air  controller  indicating 
that  the  pilot  is  going  to  complete  the  intercept  and  launch  an  attack. 

j.  "Confirm  Target.  " This  message,  which  includes  a bearing  and 
range,  is  given  to  the  pilot  when  the  air  controller  thinks  the  pilot  may  be 
attacking  the  wrong  bogey. 

k.  "ID  Run.  " A command  from  the  air  controller  to  the  pilot  to  iden- 
tify the  bogey  visually. 

l.  "Negate  ID  Run.  " 

m.  "Bogey  Jinking.  " A message  from  the  air  controller  to  the  pilot 
indicating  that  the  bogey  is  turning,  accelerating,  or  changing  altitude. 

n.  "Bogey  Altitude.  " A message  from  the  air  controller  giving  the 
pilot  the  estimated  altitude  of  the  bogey. 

o.  "Bogey  Speed.  " A message  from  the  air  controller  giving  the 
pilot  the  speed  of  the  bogey. 

p.  "Report  Bogey  Altitude.  " A message  from  the  air  controller  to 
the  pilot  requesting  the  altitude  of  the  bogey.  This  request  can  be  made 
only  after  the  pilot  has  acquired  the  bogey  on  the  interceptor's  search 
radar. 
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Intercept  Phases  — For  purposes  of  validation  and  interpretation  of 
AIC  messages,  an  intercept  is  broken  down  into  the  following  six  phases; 

a.  Phase  1;  CAP  Vectoring  Phase.  An  interceptor  is  in  phase  1 if  it 
is  not  in  an  offensive  situation  (in  orbit,  returning  to  carrier,  etc.  ) or  if  it 
is  in  an  offensive  situation  but  the  bogey  is  outside  of  the  Air  Intercept  (AI) 
radar  search  cone. 

Entry  to  phase  1 is  by  exercise  definition  or  by  shift  from  another  phase. 
Phase  1 is  shifted  to  phase  2 when  the  bogey  is  in  the  search  cone  of  the 
AI  radar. 

b.  Phase  2:  CAP  Radar  Search  and  Confirm  Phase.  Every  time  the 
bearing-and-range  message  is  sent  to  the  CAP  in  phase  2,  a search  is 
made  by  the  computer  in  a "box"  about  the  point  defined  by  the  position 
message.  If  a contact  is  found  which  is  within  both  the  box  and  the  geo- 
metrical limits  of  the  AI  radar,  it  is  reported  to  the  pseudo  pilot.  The 
pseudo  pilot  relays  it  to  the  air  controller  as  "Contact  (bearing,  range).  " 

If  no  contacts  are  found,  no  reply  is  made. 

When  the  pseudo  pilot  and  the  air  controller  agree  on  which  contact  is  the 
bogey,  the  air  controller  gives  a "Contact  Confirmed  (Your  Bogey)"  mes- 
sage. The  CAP  and  bogey  are  linked  for  the  phases  to  follow;  phase  2 is 
terminated  and  phase  3 is  entered. 

c.  Phase  3;  CAP  Radar  Lock-on  Phase.  During  this  phase,  the  CAP 
is  still  receiving  advisories  from  the  air  controller.  Periodic  checks  are 
made  to  confirm  that  the  bogey  is  maintained  in  the  search  cone  of  the  CAP 
radar.  If  the  bogey  comes  out  of  the  search  cone,  a "Lost  Contact"  mes- 
sage is  sent  from  the  computer  to  the  pseudo  pilot  and  the  phase  shifts  back 
to  phase  1.  If  the  bogey  remains  in  the  search  cone,  a check  is  made  to 
see  if  the  bogey  is  within  the  lock-on  cone  of  the  CAP  radar;  if  it  is  not,  no 
further  action  is  taken. 

If  the  bogey  is  within  the  lock-on  cone,  the  phase  shifts  to  phase  4 and  the 
computer  asks  permission  of  the  exercise  controller  to  attack  the  bogey  by 
displaying  a LOCK  ON?  flag  in  the  Digital  Read  Out  (DRO). 

d.  Phase  4:  "Judy"  Phase.  Commands  will  be  accepted  from  the  AIC 
as  in  phase  3.  Periodic  checks  are  made  to  confirm  that  tlie  bogey  is 
maintained  in  the  lock-on  cone.  If  the  bogey  comes  out  of  the  search  cone, 
the  LOCK  ON?  message  is  retracted,  a "Lost  Contact"  message  is  sent, 
and  phase  shifts  back  to  phase  1.  If  the  bogey  comes  out  of  the  lock-on  cone 
but  remains  in  the  search  cone,  the  LOCK  ON?  message  is  retracted  and 
phase  shifts  back  to  phase  3. 
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If  the  bogey  remains  in  the  lock-on  cone,  nothing  done  until  the  pseudo 
pilot  punches  JUDY  into  the  computer.  At  receipt  of  a "Judy"  message, 
the  computer  (simulating  a pilot)  takes  control  of  the  interceptor,  attacks 
the  bogey,  and  shifts  to  phase  5. 

A "Judy"  message  cannot  be  punched  into  the  computer  unless  the  LOCK 
ON?  message  is  displayed. 

e.  Phase  5;  Attack  Phase.  During  this  phase,  the  computer  flies 
the  CAP  and  attempts  to  get  into  position  for  a missile  launch.  No  pilot 
commands  that  would  affect  the  attack  on  the  confirmed  bogey  are  accepted 
except  a speed  command. 

AIC  commands  that  indicate  the  CAP  is  attacking  the  wrong  bogey  are  ac- 
cepted and  cause  a phase  shift  back  to  phase  1.  If  the  bogey  comes  out  of 
the  search  cone  or  the  lock-on  cone  due  to  bogey  jinking,  a "Lost  Contact" 
message  is  sent  to  the  AIC  and  the  phase  shifts  to  phase  1 or  phase  3. 

When  in  position,  a missile  is  launched,  "Fox"  message  is  sent  to  the  AIC, 
and  the  outcome  of  the  intercept  is  determined.  The  type  of  missile 
launched  depends  on  weapon  stores  and  attack  geometry. 

Phase  5 is  ended  and  the  phase  shifts  to  phase  1 if  a "Skip  It"  command  is 
received  or  if  the  bogey  or  the  CAP  is  shot  down. 

f.  Phase  6;  Simulated  "Lost  Contact"  Phase.  During  the  attack  phase 
of  a random  number  of  intercepts,  a "Continue  Bogey  Dope"  or  "Lost  Con- 
tract" message  is  sent  to  the  AIC  (even  though  the  CAP  maintains  radar 
lock-on)  and  the  phase  is  shifted  to  phase  6. 

In  this  phase  6,  all  the  commands  that  are  legal  in  phase  5 are  accepted 
and  interpreted  as  in  phase  5.  In  addition,  turn  recommendations  and 
position  messages  are  accepted.  The  turn  commands  are  recorded  but 
not  executed.  The  position  message  is  recorded  and  the  actual  bearing 
and  range  are  computed  and  recorded. 

Conditions  that  cause  phase  shifts  in  phase  5 will  cause  the  same  shifts  in 
phase  6. 


Course  Limitations 


In  general,  everyone  concerned  (especially  the  instructors  and  students) 
are  very  pleased  with  the  new  AIC  course  structured  around  the  levels 
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presented  earlier.  Nevertheless,  some  problem  areas  can  be  identified, 
and  these  are  presented  in  the  following  paragraphs. 

TACDEW  — The  TACDEW  system  is  currently  limited  to  only  two 
channels  to  support  AIC  training.  One  channel  supports  levels  1—6  and 
12  — 13;  the  other  channel  rotates  through  levels  7—11.  This  results  in 
some  confusion  between  the  week-1  students  (levels  1—6)  and  the  week -3 
students  (levels  12  and  13)  especially  when  the  latter  are  working  on  over- 
lapping video  (mixing  live  and  synthetic  radar).  The  week- 2 students 
(levels  7 — 11)  must  step  through  the  levels  in  rigid  fashion,  causing  both 
the  slow  and  fast  learners  to  become  frustrated. 

PC&E  Support  — The  quality  of  pseudo-pilot  support  in  relation  to 
usable  time  during  the  training  day  (0715—  1115,  1230  — 1515)  has  improved 
this  year.  Nevertheless  the  "pilots”  are  not  well  trained  and  even  the 
good  ones  get  bored  and  make  mistakes.  It  is  difficult  for  the  controllers 
to  be  convinced  they  are  operating  in  a realistic  situation.  A rhythm  must 
be  established  between  the  controller  and  aircrew;  this  is  difficult  to  learn 
using  the  pseudo  pilots. 

Scenario  Preparation  — Updating  the  training  scenarios  is  a long  and 
difficult  process.  The  examples  used  in  each  level  are  limited  and  need  to 
be  expanded.  Level  six,  for  example,  has  only  two  examples.  The  trainee 
will  memorize  them  in  an  hour  and  training  essentially  ceases. 

Special  Purpose  Training  — The  present  AIC  course  does  not  address 
some  of  the  special  training  problems,  such  as: 

a.  Refresher  training  for  fleet  controllers. 

b.  Supervisor  training. 

c.  Advanced  synthetic  training  during  the  second  three-weeks  of  tiie 
course. 

d.  Remedial  training  — there  is  no  second  shift  and  hence  slower 
students  cannot  get  extra  training  time. 

L-TRAN  - Training  in  the  basic  NTDS  environment  requires  teaching 
manual  and  functional  operation  of  the  NTDS  display  consoles.  Currently, 
considerable  time  is  spent  in  classroom  lectures  explaining  the  uses  of 
console  modes.  Often  much  time  passes  before  the  student  receives  any 
"hands  on"  practice  in  those  modes.  Such  a teaching  schedule  can  be  time 
consuming,  because  part  of  the  lecture  material  might  have  to  be  reviewed 


42 


NAVTRAEQUIPCEN  77-M- 1058-1 


at  the  console.  (The  student  probably  will  not  remember  the  entire  lecture.  ) 
A more  efficient  and  effective  situation  would  allow  the  student  to  try  out  a 
console  action  at  the  same  time  he  is  learning  about  the  capability.  The 
Lesson  Translator  (L-TRAN)  Program  is  an  off-line  computer  program 
that  accepts  lesson  material  written  by  NTDS  instructors  in  their  familiar 
Navy  language  while  following  a few  simple  format  rules.  L-TRAN  is 
presently  limited  in  its  usefulness  to  the  AIC  course,  but  it  could  be  very 
useful  if  updated,  L-TRAN  programs  which  are  available  cover  too  many 
modes  and  situations,  and  are  equipment  oriented  rather  than  job  oriented. 

Fleet  Feedback  — No  formal  fleet  feedback  is  being  used  at  this  time. 

It  may  be  useful  to  establish  a system  such  that  reports  on  former  students 
can  be  received  at  3,  6,  and  12  month  intervals  after  completion  of  the 
AIC  school. 
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SECTION  III  I 

AIC  VOCABULARY  \ 

» 

! 

Introduction 

The  AIC  vocabulary  has  been  of  particular  interest  in  this  study  because 
of  its  impact  on  the  system  requirements  for  computer-based  speech  recog- 
nition. Whether  viewed  as  simply  an  automated  replacement  for  pseudo-  t 

pilots,  or  as  the  foundation  of  a fully  automated- adaptive  training  system,  I 

speech  recognition  can  improve  system  efficiency  and  training  effectiveness. 

But  not  all  verbalizations  can  be  automatically  understood  by  a computer; 

the  feasibility  of  effectively  applying  this  new  technology  to  training  tasks  is,  I 

in  large  measure,  based  on  the  specific  phraseology  associated  with  that  i, 

task.  The  development  of  such  design  guidelines  for  incorporating  computer 

speech,  understanding  in  training  systems  is  at  the  heart  of  NAVTRAEQUIP-  , 

CEN's  continuing  research  programs.  * 

The  following  subsection  discusses  the  AIC  phraseology  in  specific  de-  | 

tail.  It  should  be  pointed  out  at  the  outset  that  the  recognition  requirement  I 

imposed  by  the  AIC  vocabulary  is  significantly  more  complex  than,  for  i 

example,  that  imposed  by  the  GCA  vocabulary.  Indeed,  the  complete  AIC 
vocabulary  cannot  be  recognized  by  any  currently  available  speech  recog- 
nition device,  unless  very  unnatural  speech  stylizations  are  rigidly  en- 
forced. Nevertheless,  the  technology  is  moving  ahead  rapidly;  and  the 
section  continues  with  a more  complete  discussion  of  the  AIC  vocabulary  re- 
quirements vis-a-vis  existing  and  future  speech  recognition  systems. 

Moreover,  the  speech  recognition  problem  can  be  eased  by  various  proce- 
dural accommodations,  the  use  of  which  will  not  deteriorate  the  training 
mission.  These  will  also  be  discussed.  Specific  recommendations  for 
further  study  are  not  made  in  this  section,  but  are  delayed  until  later  sec- 
tions of  the  report. 

The  Phraseology 

The  methodology  employed  to  extract  the  AIC  vocabulary  was  to  list  all 
terminal  objectives  that  were  associated  with  a verbal  skill,  and  then  to  list 
sample  phraseology  associated  with  each  objective.  Table  6 shows  the 
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results  of  this  process  (refer  also  to  the  level  twelve  scenario  in  lablc  Z). 
Table  6 does  not  show  all  possible  combinations,  of  course;  nor  does  it  snow 
that  aircraft  call  signs,  such  as  "Skyking  two  zero  three"  or  "Viper,  " can 
precede  any  message;  and  that  "over"  can  follow  any  message.  Phrases  are 
often  combined  too,  for  example  "vector  ZZO  for  bogey,  tracking  135, 
speed  point  six.  " The  present  effort  could  not  support  an  exhaustive  study 
of  all  AIC  phraseology  for  all  mission  segments.  However,  sufficient  infor- 
mation was  gathered  to  gain  insight  into  the  speech  recognition  problems 
associated  with  the  AIC  task. 

Speech  Recognition;  State-of-the-Art 

It  is  not  our  intention  here  to  present  a complete  review  of  the  state-of- 
the-art  in  speech  recognition.  Indeed,  NAVTRAEQUIPCEN  is  already  un- 
doubtedly aware  of  the  current  state  of  affairs.  But  for  the  less  informed 
reader,  the  following  paragraphs  briefly  highlight  what  can  and  cannot  be 
done  today,  and  what  extensions  to  the  existing  capabilities  can  be  expected 
in  the  near  future. 

Today's  speech  recognition  units  are  phrase  recognizers:  they  start 
listening  when  the  student  starts  talking,  and  they  stop  listening  when  the 
student  stops  talking.  Everything  in  between  is  then  taken  as  a unit  and  is 
compared  with  a priori  data  representing  the  phrases  to  be  recognized. 
When  a reasonably  close  match  is  found,  the  student's  voicing  is  identified. 
This  scheme  imposes  certain  restrictions  on  the  speech  recognition  capa- 
bility, viz: 

a.  The  entire  recognition  vocabulary  must  be  composed  of  well 
defined  phrase  elements. 

b.  The  system  can  not  recognize  individxial  key  words  embedded 
within  an  utterance. 

c.  The  speaker  must  pause  between  each  identifiable  element  in  a 
multiword  phrase. 

d.  The  number  of  unique  identifiable  elements  is  limited  by  both 
practical  considerations  (e.  g.  , core  space  to  hold  the  reference  data)  and 
the  potential  of  intra-phrase  confusions  (many  phrases  which  differ  only 
slightly  can  be  easily  misrecognized). 

e.  The  system  assumes  that  all  inputs  are  potentially  recognizable, 
and  hence  has  a tendency  to  "guess"  at  nonsense  inputs. 
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TABLE  6.  AIC  PHRASEOLOGY 


Terminal  Objective 

Level 

Sample  Messages 

Transmit  magnetic  bearing  and 
range  to  a target’  from  ownship. 

1 

"Bogey  — one  six  zero,  fifty 
"Bogey  southwest,  seven" 
"Bogey  your  3 o'clock, 
seven" 

Transmit  target  track  and 
ground  speed. 

2 

"Bogey-tracking  two  zero 
zero,  speed  point  six" 
"Bogey  tracking  northwest" 
"Bogey  jinking  left" 

Transmit  target  track  jink 
direction. 

3 

"Bogey  jinking  left" 

Transmit  target  ground  speed 
jink. 

3 

"Bogey  jinking,  speed 
increasing" 

"Bogey  speed  decreasing" 

Transmit  target  altitude. 

3 

"Bogey  altitude  thirty 
thousand" 

"Bogey  climbing"  "Bogey 
descending" 

Transmit  in-the-dark  calls. 

4 

"You're  in-the-dark" 
"Bogey  in-the-dark" 

Relay  orders  from  TAO/SWC 
to  CAP. 

5 

"Vector  two  two  zero  for 
bogey" 

"Cleared  to  fire" 

"Anchor  port /starboard" 
"Tighten  turn" 

Respond  to  "Contact,  " "Judy.  " 

5 

"That  is  your  bogey" 

Transmit  target  splits. 

6 

"Bogey  splitting" 

Transmit  bogey  composition 
and  formation. 

7 

"Bogey  in  a combat  spread, 
2 miles" 

"Bogeys  in  a right  echelon 
3 miles" 

"Bogeys  in  trail,  1 mile" 
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TABLE  6.  AIC  PHRASEOLOGY  (Cent), 


Terminal  Objective 
Transmit  time  in  fight. 

Transmit  aircraft  out  of  fight. 

Identify  one  friendly  aircraft  from 
another  using  IFF. 

Recommend  heading  to  maintain 
a specific  track. 

Transmit  information  on 
weather  points. 

Transmit  stranger  information. 


Transmit  information  to  assist 
in  emergencies  and  search  and 
rescue  operations. 

Provide  assistance  to  aircrews 
experiencing  radar  and/or 
radio  jamming. 

Transmit  MIG/SAM  warnings. 

Recommend  return  to  force 
headings. 

Establish  communication  with 
aircraft. 


Transmit  headings  for  training 
set-ups. 


Level  Sample  Messages 


8 "One  minute"  (given  every 

minute) 

8 "Aircraft  out  of  fight" 

9 "Squawk  ident" 

"Squawk  five  seven  four  one 

9 "Port  three  two  zero  to 

maintain  track" 

"Tighten  turn" 

9 "Point  B 270-25" 

9 "Stranger  210/7,  tracking 

320,  speed  point  6 altitude 
30  thousand" 

9 Various  — not  well  defined 


10  No  new  vocabulary. 


1 1 No  new  vocabulary. 

11  "Vector  three  two  zero  for 

the  area" 

"Breakaway  two  seven  zero' 

12  "Roger,  radar  contact" 
"Mark  your  TACAN" 

"Say  lost  communication 

intentions" 

12  "Anchor  port" 
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TABLE  6.  AIC  PHRASEOLOGY  (Cent). 


Terminal  Objective 

Level 

Sample  Messages 

Transmit  headings  for  area 
control. 

12 

"Vector  three  two  zero  for 

the  area" 

"Breakaway  two  seven  zero" 

Relay  state  and  status  reports. 

13 

"What  state?  " 

I 


These  and  other  "restrictions”  have  provided  the  impetus  for  various 
research  programs  to  extend  the  capability  of  speech  recognition  systems. 
Many  groups  are  attempting  to  develop  a nearly  unrestricted  continuous 
speech  recognition  capability,  but  the  probability  that  these  efforts  will 
realize  truly  useful  (applicable)  systems  in  the  near  future  (next  five  years) 
is  very  low.  NAVTRAEQUIPCEN,  on  the  other  hand,  has  taken  the  posi- 
tion that  a more  limited  continuous  speech  recognition  (LCSR)  capability  is 
both  technically  feasible  and  extremely  useful,  and  can  be  developed  in  the 
very  near  future  (within  two  years).  They  are  currently  supporting  such  an 
effort,  with  the  hopes  of  realizing  a real-time  capability  for  recognizing 
continuous  strings  of  digits  and  the  word  "point"  before  1979. 

Speech  Recognition  and  the  AIC  Vocabulary 

Surveying  the  AIC  phraseology  documented  in  a previous  subsection, 
together  with  an  understanding  of  the  speech  recognition  technology,  has  led 
to  the  following  conclusions: 

a.  Only  isolated  portions  of  the  AIC  training  tasks  can  be  supported 
by  the  currently  available  phrase  recognition  systems;  and  even  here,  somt; 
form  of  speech  stylization  (pausing)  would  be  required  (e.  g,  , establishing 
communications  with  aircraft). 

b.  The  complete  AIC  phraseology,  as  currently  defined,  without  mod- 
ification (including  stylization),  cannot  be  automatically  recognized  even 
with  a basic  LCSR  capability  (e.  g.  , "Stranger  210/7,  tracking  320,  speed 
point  6,  altitude  30  thousand"). 

c.  A significantly  large  portion  of  the  AIC  vocabulary  can  be  recog- 
nized by  using  a mixed  strategy  of  isolated  phrase  recognition,  an  expanded 
LCSR  capability,  and  minimal  stylization  constraints  (e.  g.  , "Port  320  . . . 
to  maintain  track"). 
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d.  A "word  spotting"  capability  could  usefully  augment  understanding 
the  intent  of  an  AIC  message,  when  the  precise  recognition  of  the  entire 
message  is  not  feasible  (e.  g.  , when  transmitting  information  to  assist  in 
emergencies). 

It  is  the  case,  in  short,  that  the  capabilities  and  limitations  of  speech 
recognition,  even  assuming  the  successful  development  of  an  L.CSR  system, 
must  impact  the  functional  specification  of  an  AIC  automated  training  capa- 
bility. This  conclusion  applies  to  both  the  "quick-fix"  as  well  as  ACTS. 

The  impact  of  this  conclusion  will  become  apparent  when  these  systems  are 
discussed  in  sections  IV  and  VI. 

ether  Accommodations 

It  is  interesting  to  note  that  in  the  AIC  course  currently  conducted  at 
FCTCP,  pseudo-pilots  (i.  e.  , human  recognition  systemsJ),  are  utilized  only 
during  levels  twelve  and  thirteen.  Of  course  the  instructors  often  monitor 
the  student's  transmissions  for  scoring  and  evaluation  purposes.  But  never- 
theless, one  is  led  to  suspect  that  significant  procedural  accommodations 
can  be  made  to  ease  the  burden  on  speech  recognition  components  of  the 
system.  This  conjecture  is  confirmed  in  conversation  with  the  AIC  instruc- 
tional cadre  at  FCTCP.  Call  signs  can  be  shortened  from  "Skyking  203"  to 
"Snake.  " Altitudes  and  speeds  can  be  kept  fixed.  Stranger  reports  can  be 
abbreviated,  etc.  Of  course  any  restrictions  of  this  sort  must  be  considered 
from  the  perspective  of  the  training  requirements  of  the  system  at  hand. 

Another  accommodation  which  could  significantly  increase  the  scope  of 
the  applicable  (feasible)  technology  is  establishing  a greater  degree  of  con- 
formity to  the  AIC  phraseology.  Although,  to  some  extent,  this  is  related 
to  the  definition  of  required  stylizations;  one  could  "legislate"  that,  for 
example,  call  sign  will  or  will  not  be  used,  that  "over"  will  not  be  used, 
that  bearings  such  as  "northwest"  or  "your  9 o'clock"  will  not  be  used,  etc. 
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SECTION  IV 

I THE  FCTCP  "QUICK-FIX" 

• The  Problem  and  the  Solution 

I 

[ 

As  noted  in  the  introduction  to  this  report,  FCTCP  is  suffering  from 
the  familiar  problems  of  limited  trainer  availability  and  a shortage  (and  the 
expense)  of  qualified  pseudo-pilots.  A simple  application  of  speech  recog- 
nition was  investigated  as  a means  of  relieving  these  problems.  The  con- 
ceived system  has  been  termed  the  "quick-fix.  " The  design  and  implemen- 
tation of  the  quick-fix  has  been  briefly  studied  during  this  effort  from  three 
perspectives;  functional  requirements,  hardware  considerations,  and  soft- 
ware considerations.  The  guiding  assumption  made  throughout  this  review 
has  been  to  determine  what  can  quickly  and  easily  be  done  to  provide  re- 
medial training  support. 

The  quick-fix  scheme  will  only  replace  the  pseudo  pilot  and  not  con- 
cern itself  with  performance  monitoring  or  evaluation.  No  "technology 
breakthroughs"  are  required  prior  to  implementation  of  the  system. 


Functional  Requirements 


Pseudo  pilots  are  currently  used  to  support  levels  IZ  and  13  training, 
and  hence  a study  of  the  quick-fix  begins  there.  During  these  levels,  the 
student  is  introduced  to  new  material  such  as  area  control  as  well  as  given 
practice  on  procedures  previously  covered  in  earlier  levels.  The  functional 
requirements  of  any  useful  new  capability  must  at  least  address  the  bulk  of 
this  new  material,  and,  if  possible,  support  the  other  aspects  of  the  run. 

Minimum  Requirements  — The  minimum  \iseful  capability  for  the  quick- 
fix  is  to  support  the  training  of  "set-ups;"  that  is,  transmitting  headings  to 
two  aircraft  for  practice  intercepts  and  area  control.  This  consists  of  (see 
figure  5); 

a.  Establishing  position  of  two  aircraft. 

b.  Separating  the  aircraft. 

c.  Turning  the  aircraft  to  intercept  each  other. 

d.  Re-separate  and  begin  again. 
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a)  Establish  Contact 


'1 

I 

I 


Figure  5.  Minimum  Quick  Fix  Requirements. 


The  vocabulary  (for  both  recognition  and  generation)  implied  by  these 
requirements  are  shown  in  table  7.  The  table  also  shows  the  stylization  that 
would  be  required  in  order  to  implement  the  automatic  speech  recognition 
using  the  available  isolated  word  systems. 

Notice  that  a built-in  confirmation  of  the  recognized  phrase  is  provided 
by  the  pilot's  response.  If  a phrase  is  misrecognized,  the  student  can 
transmit  a "negative,  " If  a phrase  is  not  recognized,  the  pilot  can  transmit 
"say  again.  " Note  too,  that  the  rejection  criteria  must  be  fairly  stringent. 
That  is,  the  student  will  be  issuing  various  advisories  to  the  pilot  which  re- 
quire no  action  on  the  part  of  the  system  (e.  g.  , tracking  information)  and 
hence  must  be  disregarded  by  the  recognition  system. 
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Expanded  Support  — A number  of  other  features  have  been  identified 
that  would  significantly  enhance  the  training  usefulness  of  the  quick-fix 
(while  still  maintaining  the  notion  of  providing  only  remedial  support). 

These  embellishments,  for  the  most  part,  involve  the  procedures  of  estab- 
lishing communication  with  the  pilot  and  assisting  during  the  intercept 
phase.  The  associated  vocabulary  requirements  were  shown  in  table  Z,  and 
the  related  vocabulary  list  is  presented  in  table  8.  The  voice  generation 
capability  must  be  more  sophisticated  with  the  expanded  capability.  But 
this  involves  low  technical  risk  and  has  impact  only  on  the  time  and  cost  of 
developing  the  system. 

The  vocabulary  listed  in  table  8 was  implemented  in  a test  configuration 
using  a Threshold  Technology  VIP- 100  speech  recognition  system.  Recog- 
nition accuracy  for  a speaker  experienced  in  using  this  system  was  good, 
though  the  necessary  pausing  required  some  familiarization.  The  test  was 
performed  in  a laboratory  environment  with  little  ambient  noise  using  a 
high-quality,  low  noise,  microphone. 


Level  13  — The  requirements  associated  with  providing  remedial  sup- 
port for  level  13  (tanker  join-ups)  were  not  addressed  during  this  study.  A 
cursory  view,  however,  indicates  that  no  significant  risk  is  involved.  This 
level  might  be  included  in  the  formal  functional  analysis  of  the  quick-fix. 

TABLE 

8. 

VOCABULARY  LIST  FOR  EXPANDED  QUICK-FIX  SUPPORT. 

one 

snake 

mark  your  TACAN 

two 

viper 

radar  contact 

three 

port 

say  lost  communications  intentions 

four 

starboard 

for  the  area 

five 

vector 

roger  . . . that  is  your  bogey 

six 

anchor 

breakaway 

seven 

negative 

tighten  turn 

eight 

as  bogey 

ease  turn 

nine 

for  bogey 

continue 

zero 

for  separation 

what  state? 

for  breakaway 
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Design  Considerations 


As  described  in  section  II,  the  synthetic  portion  of  the  AIC  course  is 
currently  supported  by  an  NTDS  configuration  with  simulated  video  provided 
by  TACDEW,  MSP,  or  ASP,  In  an  effort  to  keep  system  development  costs 
to  a minimum,  the  quick-fix  scheme  should  make  maximum  use  of  these 
programs.  In  this  and  the  following  subsections,  the  modifications  and 
additions  to  the  existing  systems  which  are  required  to  support  the  quick- 
fix  are  reviewed.  The  intent  here  is  not  to  perform  even  a preliminary 
system  design,  but  rather  to  scope  the  problem  sufficiently  to  provide  both 
technical  and  budgetary  visibility. 

A variety  of  alternative  configurations  were  reviewed,  A principal 
design  consideration  throughout  has  been  to  impact  the  existing  programs  in 
a minimal  way.  Another  consideration  championed  by  FCTCP  personnel, 
was  to  provide  the  quick-fix  capability  in  addition  to  the  usual  TACDEW 
training.  The  configuration  depicted  in  figure  6 meets  these  goals.  Essen- 
tially, the  existing  15G17  (the  CRT  Target  Control  Subsystem)  is  replaced 
by  an  entirely  new  subsystem,  nicknamed  EGOR.  By  utilizing  the  one  com- 
puter MSP  for  AIC  training,  the  multicomputer  TACDEW  plus  the  15G17  can 
be  simultaneously  used  to  support  other  FCTCP  training  (e.  g.  , CCA,  etc.  ). 
Indeed,  TACDEW  could  still  support  AIC  training  not  associated  with  the 
quick  fix  (level  12).  Note  too  that, if  EGOR  is  properly  designed,  no  mod- 
ifications will  be  required  to  the  USQ-20  software  (NTDS  and  the  MSP). 

The  data  exchange  between  the  MSP  and  EGOR  becomes  a subset  of  the 
existing  exchange  between  the  15G17  and  the  MSP. 


Hardware  Requirements 


The  hardware  requirements  for  EGOR  are  briefly  reviewed  in  the  fol- 
lowing paragraphs.  Figure  7 shows  a possible  interrelationship  of  the 
various  components.  Table  9 itemizes  the  specific  equipment  required. 

Computer  Communications  Interface  Circuit  Board  (CCICB)  — The 
CCICB  is  a 15"  by  15"  printed  circuit  board  manufactured  by  Logicon,  Inc. 
residing  in  the  Programmable  Buffered  Multiplexer  (PBM)  which  provides 
the  interface  between  the  USQ-20  in  the  MSP  and  the  PBM  (Nova)  in  EGOR. 
Because  of  the  differences  of  such  characteristics  as  word  size,  processor 
speed,  and  input/output  (I/O)  parameters  between  the  USQ-20  and  the  PBM, 
there  is  no  direct  means  of  communication  possible  on  the  I/O  channels  of 
the  two  computers.  The  CCICB  functions  to  make  the  two  systems  compat- 
ible and  communications  efficient. 
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Figure  6.  FCTCP  Quick-Fix  Configuration. 


Figure  7.  EGOR  Hardware  Configuration 


TABLE  9.  EGOR  HARDWARE  COMPONENTS. 
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Programmable  Buffered  Multiplexer  (PBM)  — The  PBM  is  a commer- 
cially produced  minicomputer  manufactured  by  Data  General  Corporation. 
The  PBM  is  the  nerve  center  of  EGOR.  In  general  it  controls  the  primary 
hardware  associated  with  the  subsystem  and  processes  the  messages  sent 
between  the  MSP  and  EGOR.  The  PBM  also  acts  as  the  link  between  tlie 
students  and  instructors  and  the  MSP.  To  accomplish  this,  the  PBM  will: 

a.  Accept  inputs  from  the  speech  recognition  units  and  the  CRT, 
convert  these  inputs  into  the  proper  format  and  relay  them  to  the  MSP. 

b.  Store  and  retrieve  voice  reference  data  from  the  mass  storage 
unit  and  relay  these  data  on  to  the  recognition  units. 

c.  Receive  data  from  the  MSP,  convert  it  to  the  appropriate  format, 
and  output  to  the  voice  generation  unit  and/or  CRT  display. 

d.  Support  student  voice  data  collection  in  an  off-line  mode. 

Speech  Recognition  Units  — The  speech  recognition  units  are  commer- 
cially produced  by  Threshold  Technology,  Inc.  (designated  the  Threshold 
500).  Each  Threshold  500  receives  an  analog  speech  signal  from  the  stu- 
dent; converts  it  into  a digital  form;  and  detects  the  presence  or  absence 
of  thirty-two  speech  features.  These  data  are  then  used  to  determine  the 
word  or  phrase  spoken  by  the  student.  The  Threshold  system  cannot  be 
multiplexed;  and  hence,  there  must  be  as  many  recognition  units  as  there 
are  input  stations.  FCTCP  has  determined  the  need  for  five  units. 

Note  that  the  Threshold  500  is  available  both  with  and  without  a micro- 
processor to  perform  the  actual  recognition  algorithm.  With  the  micro- 
processor, the  output  of  the  recognition  unit  is  an  American  Standard  Code 
for  Information  Interchange  (ASCII)  character  representing  the  recognized 
word.  Without  the  microprocessor,  the  output  is  32  parallel  bits  of  data 
every  2 milliseconds,  representing  the  32  speech  features.  In  the  latter 
case,  the  recognition  algorithm  must  be  performed  in  the  PBM.  Because 
of  PBM  memory  and  PBM  processor  considerations,  especially  interrupt 
processing  rates,  it  appears  that  the  Threshold  500  with  the  microprocessor 
should  be  utilized  in  this  application. 

However,  to  support  the  off-line  Voice  Data  Collection  program  (dis- 
cussed later  in  this  section)  one  of  the  Speech  Recognition  Units  should  be 
capable  of  providing  the  raw  feature  data,  as  well  as  the  microprocessor/ 
ASCII  code  output.  It  may  be  desirable  to  provide  a separate  Threshold  500 
for  this  data  collection  purpose,  in  which  case  the  microprocessor  on  this 
unit  would  not  be  necessary. 
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Voice  Generation  Unit  — The  voice  generation  unit  is  a Votrax  VS-6 
manufactured  by  the  Voice  Interface  Division  of  Federal  Screw  Works.  The 
Votrax  electronically  synthesizes  the  basic  building  blocks  of  spoken  English, 
and  hence  can  speak  any  word  by  joining  together  these  sounds  under  soft- 
ware control.  A single  Votrax  may  be  sufficient  in  this  application,  pro- 
vided the  output  can  be  multiplexed  to  the  appropriate  student  station,  but 
this  must  be  confirmed  during  system  design.  The  functional  purpose  of 
the  voice  generation  unit  is  to  simulate  the  voice  transmissions  normally 
issued  by  a pilot  or  pseudo-pilot. 

Voice  Generation  Switching  Box  — This  unit  contains  special  purpose 
switching  circuitry  which  accepts  a command  word  from  the  PBM,  together 
with  the  output  of  the  voice  generation  unit,  to  direct  the  synthesized  speech 
to  the  appropriate  channel  of  the  intercommunication  and  preamplification 
system  (ICS).  This  unit  may  be  built  into  the  ICS. 

System  Mass  Storage  Unit  — Off-line  storage  will  be  needed  to  store 
the  voice  reference  data  for  the  students.  In  addition,  storage  is  required 
for  the  PBM  programs,  software  development  aids,  and  system  diagnostics. 
A disk  system  is  recommended;  such  as  the  10  megabyte  cartridge  disk  sys- 
tem marketed  by  Data  General  Corporation.  Detailed  system  design  may 
demonstrate  that  a floppy  disk  system  is  sufficient,  however,  which  is 
approximately  half  the  cost  of  the  larger  disk. 

System  CRT  — The  primary  system  terminal  is  a CRT  similar  to  those 
currently  employed  in  the  15G17  (i.  e.  , an  Infoton  or  TEC  data  terminal). 

The  CRT  will  be  used  to  initialize  EGOR,  as  well  as  input  a variety  of  sys- 
tem and  AIC  commands  (as  in  the  15G17)  which  are  not  handled  by  the 
speech  recognition  units. 

Printer  — The  15G3  7 utilizes  an  Inktronic  Printer,  manufactured  by  the 
Teletype  Corporation,  to  display  general  information  messages  or  those 
required  for  MSP  operation.  A similar  function  will  be  performed  by 
EGOR's  printer. 

Intercom  System  and  Preamplification  (ICS)  — The  existing  Radio  Phone 
Units  at  FCTCP  were  tested  for  noise  level  and  found  to  be  unsatisfactory 
(too  noisy:  approximately  26  db  signal-to-noise  ratio)  for  utilization  by  the 
speech  recognition  units.  Indeed,  the  instructors  at  FCTCP  indicated  that 
the  cross  talk  between  stations  is  sometimes  so  bad  that  it  is  difficult  to 
determine  with  which  "pilot"  the  AlC  is  communicating  I 
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The  need  for  a totally  separable  ICS  appears  clear.  At  least  eight 
ports  should  be  provided:  5 student  locations,  2 instructor  monitoring  sta- 
tions, and  one  remote  station  near  the  system  CRT  for  student  voice  "train- 
ing" (collecting  the  reference  data  for  speech  recognition).  On  the  system 
side,  the  ICS  must  accept  the  five  inputs  from  the  Voice  Generation  Switch- 
ing Box  and  also 'interface  to  the  five  Speech  Recognition  Units.  Appropriate 
preamplification  and  equalization  of  these  inputs  will  be  required.  A switch- 
ing arrangement  must  be  designed  into  the  ICS  so  that  any  recognition  unit 
can  be  associated  with  any  student  station  to  maximize  system  reliability  in 
the  event  of  hardware  (UYA-4  console  or  EGOR  component)  malfunction. 

Student  and  Instructor  Stations  — Adjacent  to  each  UYA-4  console  will 
be  a headset  station  containing  both  input  and  output  level  controls,  an  input 
level  indicator,  and  a headset  jack.  The  input  level  controls  and  indicator 
are  needed  to  ensure  that  the  student  speaks  at  proper  volume  for  speech 
recognition  purposes.  Special  headsets  should  also  be  provided  to  benefit 
from  the  noise  cancelling  microphones  which  optimize  the  recognition  ac- 
curacy. At  other  key  locations,  instructor  monitoring  stations  must  be 
provided  consisting  of  a switch  to  enable  monitoring  of  any  student  station, 
a speaker,  a volume  control,  and  headphone  jack.  The  instructor  must  be 
able  to  communicate  with  the  student  through  the  monitoring  station. 

Finally,  an  additional  student  input  station  must  be  located  next  to  the  sys- 
tem CRT  to  facilitate  voice  reference  data  collection. 

Data  Flow  Across  the  Interface 


It  is  especially  important  to  preserve  the  existing  data  format  across 
the  USQ-20/EGOR  interface.  Recall  that  this  transfer  will  be  affected  by 
the  CCICB.  The  following  paragraphs  describe  the  data  flow  more  specif- 
ically. Refer  to  figure  8. 

CCICB/USQ-20  Inputs  to  the  PBM  - CCICB  inputs  consist  primarily 
of  the  following: 

a.  Track  parameter  of  targets  being  controlled. 

b.  Error  diagnostics  of  errors  found  by  the  MSP. 

c.  Track  status  messages  generated  by  the  MSP. 

d.  System  status  messages  (e.  g.  , "Drop  T rack"  and  "Freeze 
Exe  rcise"). 
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Figure  8.  Data  Flow  Between  the  MSP  and  PBM. 


e.  System  messages  for  the  printer. 

f.  Various  control  signals  to  facilitate  communication  between  the 
USQ-20  and  PBM.  Note  that  the  CCICB  is  just  a sophisticated  relay  device 
and  as  such  does  not  originate  or  generate  data.  It  only  relays  data  re- 
ceived from  the  USQ-20  and  processes  it  sufficiently  to  make  it  acceptable 
to  the  PBM. 

Input  from  the  CCICB  to  the  PBM  will  be  in  the  synchronous  digital 
transmission  mode  (i.  e.  , continuous  data  transmission  versus  asynchro- 
nous or  "as  required"  mode).  Data  will  be  input  on  one  line  in  serial 
format. 

Information  coming  to  the  CCICB  from  the  USQ-20  will  be  contained  in 
data  blocks  similar  in  format  to  MSP  intermodule  messages.  They  will  be 
transferred  from  the  USQ-20  to  the  CCICB  one  30-bit  word  at  a time  over 
30  parallel  data  lines.  After  the  CCICB  receives  a 30-bit  word,  it  will 
break  it  into  six  5-bit  units  (figure  9);  add  up  to  three  dummy  bits  to  each 
unit;  and  then  transmit  each  8-bit  unit  to  the  PBM.  This  is  necessary  to 
ensure  ASCII  character  compatibility. 
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Figure  9.  Digital  Format  (Synchronous  Mode). 


When  transmitted  to  the  PBM,  each  group  (block)  of  8 -bit  units  will  be 
preceded  by  a 7-bit  ASCII  SYNC  character  (generated  by  the  CCICB).  This 
will  be  followed  by  a 7-bit  ASCB  "End-Of-Text"  (ETX)  character  (gener- 
ated by  the  CCICB),  enabling  the  PBM  to  recognize  data  when  they  are  re- 
ceived (figure  10), 

PBM  Outputs  to  the  CCICB/USQ-ZO  — Outputs  from  the  PBM  to  the 
CCICB  consist  primarily  of  control  requests  and  commands  for  further 
transfer  to  the  MSP,  These  control  requests  and  commands  are  in  blocks 
of  data  in  format  similar  to  MSP  intermodule  messages. 

Output  to  the  CCICB  will  be  in  the  synchronous  digital  transmission 
mode  and  will  include  special  signals  to  control  CCICB  functions.  Data  will 
be  output  on  a single  line  in  serial  format. 

Data  transfer  from  the  PBM  to  the  MSP  is  processed  somewhat  the 
reverse  of  that  described  previously.  Data  are  transferred  as  8-bit  units 
from  the  PBM  to  the  CCICB,  A group  (block)  of  8-bit  units  is  preceded  by 
two  SYNC  codes  and  followed  by  an  ETX  code.  The  CCICB  retrieves  the 
first  five  bits  of  each  8-bit  unit  as  data,  and  builds  a 30-bit,  USQ-20  word 
from  them.  The  CCICB  then  transfers  the  word  to  the  USQ-20  on  30- 
parallel  data  lines. 
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Figure  10.  CCICB /PBM  Synchronous  Data  Transmission. 
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Software  Requirements 


This  section  describes,  in  very  general  terms,  the  software  require- 
ments of  the  PBM.  An  off-line  program  will  be  required  to  support  the 
generation  of  voice  reference  data.  This  will  be  discussed  first  followed  by 
the  various  functions  that  the  PBM  program  must  perform  during  the  actual 
training  exercise.  Table  10  suggests  estimated  labor-hours  required  for 
software  development. 

Voice  Data  Collection  — Recall  that  the  speech  recognition  algorithms 
require  an  a priori  data  base  against  which  to  compare  unknown  (input) 
speech  data  and  make  a selection  of  the  word  or  phrase  spoken.  These 
reference  data  are  formed  in  an  off-line  process  with  the  help  of  the  Voice 
Data  Collection  program.  Briefly,  the  procedure  is  to  prompt  the  student 
to  say  a word  or  phrase  a number  of  times  (5  to  10),  saving  the  voice  data 
generated  by  each  vocalization.  Finally,  the  data  for  each  vocabulary  item 
are  merged  or  averaged  together  to  form  the  reference  data.  The  student 
then  enters  a validation/practice  phase  wherein  he  checks  the  accuracy  of 
the  extracted  data.  The  process  is  repeated  until  good  recognition  is 
achieved.  One  or  two  hours  is  generally  required  to  bring  accuracy  levels 
up  to  the  high  90%  region. 


TABLE  10.  LABOR  ESTIMATES  FOR  FCTCP  QUICK-FIX 
SOFTWARE  DEVELOPMENT. 

Software  Development  Labor  (weeks) 


Voice  Data  Collection 

Functional  Definition  2 

Design  and  Implementation  6 

Software  Documentation  2 

User  Handbook  3 

PBM  On-Line  Software 

Functional  Definition  6 

Design  6 

Implementation  12 

Software  Documentation  4 

Operator  Handbook  4 

Subtotal  44 

Software  Management  6 

Total  50 
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NAVTRAEQUIPCEN  has  conducted  a considerable  amount  of  research 
in  this  area.  They  have  determined  that  the  best  results  (highest  accuracy) 
IS  achieved  by  presenting  the  words  and  phrases  in  the  context  in  which  they 
will  be  used  during  recognition.  Instead  of  saying  a word,  such  as  "Viper", 
ten  times  in  succession,  the  word  should  be  used  in  a typical  phrase  ten 
times,  interspersed  with  other  phrases.  This  procedure  has  the  added 
benefit  of  teaching  the  student  the  proper  vocabulary  and  required  styliza- 
tions, at  the  same  time  as  the  computer  is  learning  the  student's  voice 
characteristics.  This  approach,  though  slightly  more  costly  than  simple 
serial  repetitions,  is  strongly  recommended  for  the  FCTCP  quick-fix. 

The  FCTCP  Voice  Data  Collection  program  can  be  modeled  after 
NAVTRAEQUIPCEN  software,  which  is  fully  described  in  NAVTRAEQUIP- 
CEN report  74-C-0048-1:  The  Use  of  Computer  Speech  Understanding  in 
Training;  A Demonstration  Training  System  for  the  Ground  Controlled 
Approach  Controller. 

On-Line,  Real-Time  Software  — The  remainder  of  this  subsection  dis- 
cusses, in  very  general  terms,  the  routines  and  their  interrelationships 
that  will  support  the  actual  on-line  system.  Further  study  of  the  existing 
(15G17)  PBM  software  will  be  needed  to  determine  its  usefulness  as  a de- 
sign guide. 

An  executive  (EXEC)  routine  will  control  processing  in  the  PBM.  The 
EXEC  will  have  basic  control  of  the  processor  and  will  schedule  all  other 
processing  as  demanded.  Processing  will  generally  be  triggered  by  inputs 
from  external  sources  (i.e.,  the  CRT,  USQ  ZO,  or  Speech  Recognition  Units). 
Upon  receipt  of  an  input,  the  EXEC  will  make  a basic  interpretation  of  the 
request  and  call  the  proper  processing  routine: 

a.  CRT  character  input  interpreter. 

b.  Recognition  unit  input  interpreter. 

c.  CRT  input  decoding. 

d.  Recognition  unit  input  decoding. 

e.  CCICB  input  decoding. 

Routines  such  as  the  following  will  be  called  as  a result  of  the  input 
decoding; 

a.  CRT  output  (including  command  line,  directory,  parameters,  and 
error  responses). 


64 


NAVTRAEQUIPCEN  77-M- 1058-1 


b.  Voice  generation  unit  output. 

c.  USQ-20  internaodule  message  formatting  and  output. 

d.  Printer  output. 

e.  Basic  conversion  routines. 

To  allow  the  programs  to  correlate  the  tracks  to  the  proper  device,  a series 
of  status  and  bookkeeping  routines  is  required. 

Input  Interpreters  — The  EXEC  will  call  these  routines  whenever  the 
CRT  or  voice  recognition  routines  signal  receipt  of  a character.  The  rou- 
tine will  check  for  certain  special  characters  requiring  immediate  action 
(e.  g.  , "negative"  or  <backspace>).  If  the  input  character  is  not  one  of  the 
special  characters,  it  is  checked  for  legality  according  to  the  command 
directories.  If  legal,  it  is  stored  for  future  decoding.  If  illegal,  an  error 
response  routine  is  called. 

CRT  and  Voice  Recognition  Input  Decoders  — These  routines  (called 
upon  receiving  legal  command  characters)  determine  the  output  required  to 
the  command  line  of  the  CRT  or  the  voice  generation  unit  and  issue  the 
request  for  output.  They  then  determine  the  next  set  of  legal  characters 
for  the  input  interpreter  routine  to  use.  If  the  command  is  complete,  the 
routine  will  retrieve  all  characters  associated  with  the  command  and  form 
it  into  data  acceptable  to  the  MSP.  The  command  will  be  associated  with 
the  proper  track.  Conversion  routines  will  be  called  as  needed  to  convert 
input  data  into  MSP  units. 

CCICB  Input  Decoding  — This  routine  will  be  called  whenever  data  are 
received  from  the  MSP  via  the  CCICB.  It  will  inspect  each  data  grouping 
and  call  the  proper  routine  to  decode  the  data.  The  following  types  of  data 
are  received  from  the  MSP; 


1 


' I a. 

Track  parameter  changes. 

b. 

Track  messages. 

c. 

Error  responses. 

d. 

System  status  changes. 

e. 

System  messages  for  the  printer. 
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CRT  Output  — Routines  will  output  command  directories,  exercise  param- 
eters and  certain  track  parameters  on  the  CRT.  When  an  illegal  entry  is 
made  at  the  CRT,  an  error  response  routine  is  called.  It  will  display  the 
illegal  character,  followed  by  two  blinking  question  marks.  The  CRT  will 
be  initialized  to  start  a new  command. 

Voice  Generation  Output  — When  a message  is  received  from  the  MSP 
for  a track,  this  routine  is  called.  It  will  determine  the  location  of  the 
track  and  output  the  message  via  the  voice  generation  unit. 

Printout  Output  — This  routine  is  called  when  a message  is  received 
from  the  MSP  for  output  on  the  printer.  It  will  handle  conversion  to  the 
proper  format  and  output  to  the  printer. 

Conversion  Routines  — In  the  process  of  formatting  data  for  the  MSP 
and  decoding  data  from  the  MSP,  the  following  conversion  routines  will  be 
required; 

a.  Degrees  to  BAMS  x 

b.  Feet  to  radar  miles  x 2^0. 

c.  Knots  to  radar  miles/ sec  x 2^^. 

d.  Mach  X 100  to  mach  x 2^^. 

e.  Decimal  to  octal. 

f.  Radar  miles  to  radar  miles  x 2^®. 

g.  Hours  to  seconds  x 2^®. 

h.  Minutes  to  seconds  x 2^0. 

Input/Output  Handlers  — This  set  of  routines  and  their  associated  sub- 
routines handle  all  actual  input/output  between  the  PBM  and  the  peripheral 
devices. 


System  Integration 


EGOR  will  require  a fair  amount  of  wiring /installation  of  FCTCP. 
NAVELEX  should  be  tasked  to  perform  this  function.  The  ICS  and  student/ 
instructor  stations  will  be  located  in  NTDS-6:  the  AIC  Synthetic  Mockup. 
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The  CRT  should,  ideally,  also  be  located  there.  The  other  equipment 
elements  can  be  housed  in  a twin  bay  19"  rack  cabinet  occupying  approxi- 
mately 12  sq.  ft.  of  floor  space.  The  location  of  this  equipment  is  not 
especially  critical  except  that  the  distance  from  NTDS-6  should  be  mini- 
mized to  facilitate  start  up  of  the  computer  and  to  prevent  noise  from 
"creeping  into"  the  audio  signals.  The  MSP  will  presumably  run  in  C&S-2, 
one  floor  directly  below  the  AIC  mockup,  and  hence  a cable  must  run  from 
there  to  the  EGOR  equipment  cabinet. 

No  functional  changes  are  expected  to  be  needed  to  the  existing  MSP, 
but  nevertheless  very  minor  modifications  may  be  required.  The  PBM  will 
probably  not  be  loaded  from  the  MACON  built  MSP  Tape,  for  example. 
FCDSSA,  Code  4,  should  be  tasked  to  provide  support  for  MSP  changes. 

Overall  system  test  and  integration  should  be  the  responsibility  of  the 
EGOR  system  developers.  Eight  to  ten  labor  weeks  should  be  allocated  for 
the  task. 
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SECTION  V 

THE  AIC/ASAC  TRAINER 
Introduction 

A large  scale  training  device  has  been  proposed  by  FCTCP  and  NAV- 
TRAEQUIPCEN to  support  air  intercept  controller  training  and  antisub- 
marine air  controller  (ASAC)  training  during  the  1980's.  This  present 
effort  has  very  briefly  studied  the  requirements  for  this  trainer  in  order 
to  1)  establish  the  framework  in  which  the  AIC  research  program  (ACTS) 
can  be  most  effective;  and  2)  determine  if  any  other  preliminary  activity 
should  concurrently  be  performed  as  precursor  to  the  development  of  the 
actual  trainer. 


Purpose  of  the  Trainer 

The  AIC/ASAC  trainer  will  provide  a high  fidelity  shipboard  simulation 
environment  consisting  of:  operational  AIC  and  ASAC  equipment;  simulated 
aircraft;  surface  and  subsurface  ships;  simulated  environmental  effects 
(e.  g.  , weather);  etc. 

In  addition  to  synthetic  or  simulated  environments,  the  AIC/ASAC 
trainer  will  still  support  training  using  live  aircraft.  A primary  concern 
of  the  instructional  cadre  regarding  live  training,  is  that  there  are  long 
periods  of  "dead"  time  between  the  airborne  communities  training  missions. 
During  these  periods  the  AIC  student  remains  idle  at  his  console.  Though 
at  FCTCP  there  are  currently  an  average  of  25  training  flights  per  day  al- 
lowing the  AIC  student  live  practice,  the  distribution  of  the  flights  is 
awkward  for  efficient  AIC  training.  Moreover,  though  the  intercept  mis- 
sions flown  range  from  simple  to  complex  for  the  pilots,  AIC  instructors 
indicated  the  range  of  training  provided  for  their  own  students  is  limited. 
They  also  indicate  that  these  limitations  on  training  are  profoundly  more 
severe  at  the  AIC  training  facility  at  Dam  Neck,  where  opportunities  for 
live  practice  are  limited  to  2 or  3 intercept  missions  per  week.  Hopefully, 
the  projected  AIC/ASAC  joint  trainer  will  alleviate  some  of  these  problems. 
For  example,  it  would  be  convenient  to  intersperse  live  and  synthetic  train- 
ing during  the  period  presently  devoted  exclusively  to  live  training.  AIC 
instructors  have  expressed  a preference  for  a system  capable  of  switching 
over  quickly  to  a synthetically  generated  training  environment  for  the 
periods  of  time  between  live  intercept  missions.  Short  duration  training 
exercises  tailored  to  a specific  level  of  training  would  be  required. 
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It  is  expected  that  trainees  using  the  device  will  primarily  develop 
proficiency  in  the  procedures  associated  with  controlling: 

a,  ASW  helicopters  (e.  g.  , LAMPS)  and  airplanes  (e.  g.  , P-3C)  en- 
route  to,  localizing,  tracking  and  attacking  submarines. 

b.  Fighter  aircraft  (e.g.  , F-14)  during  air  interceptions. 

In  addition,  trainees  will  develop  skills  in  controlling  aircraft  in  various 
other  missions  such  as  search  and  rescue,  mine  laying,  and  so  forth.  From 
a training  standpoint  ASAC  job  responsibilities  are  similar  to  those  of  the 
AIC.  Though  not  explored  in  detail,  the  following  factors  have  been  noted: 

a.  Amount  of  training  required  for  the  ASAC  student  is  estimated  to 
be  the  same  or  greater  than  the  AIC. 

b.  Student  load  factor  will  probably  be  about  the  same  as  for  AIC. 

c.  Present  utilization  of  training  devices  is  not  as  extensive  as  is  the 
case  with  AIC,  though  it  should  be  as  extensive  or  more  so. 

FCTCP  has  identified  the  need  for  a stand-alone  trainer  (i.  e.  , not  tied 
to  the  existing  TACDEW  complex)  which  can  run  19  hours  a day  and  teach 
approximately  a dozen  students,  each  student  at  differing  or  the  same 
"levels.  " This  requirement,  in  turn,  practically  demands  the  utilization 
of  speech  recognition  and  generation  to  avoid  the  costs  associated  with  pro- 
viding pseudo-pilots,  and  some  form  of  automated  and  adaptive  training  to 
provide  relief  to  the  instructors.  The  proposed  trainer  will  ideally  incor- 
porate all  of  these  features. 


Current  Status  of  the  Trainer 


Implementation  of  the  AIC/ ASAC  trainer  has  been  scheduled  to  begin 
in  July,  1980.  The  Analysis  and  Design  branch  of  the  Systems  Engineering 
Division  at  NAVTRAEQUIPCEN,  Code  N2211,  is  in  the  process  of  develop- 
ing a l\uu.lional  statcmcnl  lor  the  trainer.  NAVTRAEQUIPCEN' s research 
program  discussed  in  the  following  section,  will  yield  further  design  speci- 
fications; particularly  in  the  areas  of  the  automated  speech  technologies, 
objective  performance  measurement,  syllabus  control,  and  student- 
instructor  feedback. 
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Lessons  Learned 

During  the  development  of  the  GCA  controller  training  system,  some 
interesting  lessons  were  learned  which  are  certainly  applicable  to  the  AIC/ 
ASAC  development  cycle.  Particularly  interesting  are  some  reflections  on 
the  design  of  training  systems;  and  these  are  discussed  below. 

As  in  any  R&D  program  designed  to  improve  an  existing  system, 
whether  it  be  hardware,  software,  or  methodology,  a basic  requirement 
is  to  take  a long,  hard  look  at  the  existing  training  methods  in  order  to 
realistically  design  a superseding,  or  complementary,  system  optimized 
by  advanced  technology  and/or  knowledge.  Typically,  systems  engineering 
requires  constraint  analysis,  and  the  development  of  techniques  and  m.ethods 
to  minimize  the  effects  of  such  constraints,  in  degrading  the  program  ob- 
jectives. Repeated  looks  at  existing  training  methods  reveal  in  some  cases 
that  they  have  indeed  been  compromised  by  hardware  systems  limitations, 
instructor  availability,  instructor/ student  ratios,  cost/benefit  ratios,  and 
similar  problems  which  were  real  and  valid  at  the  time  of  development.  In 
this  fluxional  world,  all  of  the  constraining  factors  have  varied  to  a lesser 
or  greater  extent.  The  analysis  of  these  factors,  while  certainly  useful 
from  both  a historical  point  of  view  and  for  providing  a starting  point  for 
a new  design,  should  revalidate  all  of  the  assumptions  prior  to  the  establish- 
ment of  a new  design  baseline.  Prior  system  inadequacies  must  be  reviewed 
in  the  light  of  today's  knowledge. 

Ideally,  training  system  design  begins  with  a fundamental  description  of 
the  problem  and  definition  of  the  training  objectives  to  be  addressed.  These 
objectives  include  the  criteria  to  be  used  as  a measure  of  their  attainment. 
While  training  objectives  may  be  the  same  in  automated  and  nonautomated 
systems,  the  means  taken  to  realize  them  may  be  very  different.  For  the 
former  determinations,  interaction  between  instmictors  and  training  analysts 
is  an  essential  element.  It  is  the  instructor  who  knows  what  can  be  e.xpected 
of  the  student  at  each  stage  in  the  training  process,  and  who  has  an  enormous 
reservoir  of  empirical  knowledge  about  what  must  be  taught.  The  training 
analyst  quantifies  these  objectives,  where  possible,  and  sifts  idiosyncratic 
knowledge  and  skills  from  uniformly  useful  or  necessary  ones.  He  also 
matches  the  objectives  with  the  instructional  features  of  the  entire  system 
and  provides  guidelines  as  to  the  optimum  means  for  realizing  the  objec- 
tives. This  process  requires  a participative  team  interaction  among  hard- 
ware and  software  specialists  and  instructional  cadre.  It  is  through  this 
interaction  among  specialists  that  a good  training  system  design  and  imple- 
mentation comes  about.  Experience  has  shown  that,  when  one  of  these  con- 
tributors is  left  out,  the  results  are  evident  in  the  training  system.  For 
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example,  a system  designed  and  built  without  solicitation  of  the  ideas  and 
suggestions  of  the  ultimate  users  suffers  an  understandable  lack  of  accept- 
ance, even  though  training  objectives  are  met  as  measured  by  objective 
evaluation  of  student  performance.  There  is  sometimes  an  understandable 
reluctance  by  users  to  vary  from  the  old  "tried  and  true"  methods  by  which 
they  either  consciously  or  unconsciously  compensated  for  known  system 
deficiencies.  This  is  indeed  one  of  the  main  advantages  of  a potentially 
open-ended,  reprogrammable  design  of  the  advanced  automated  system 
trainer.  Empirical  data  from  a myriad  of  advanced  development  projects 
consistently  show  that,  once  the  user  grasps  the  enormous  potential  for 
improved  training  of  a modern  automated  system,  a wellspring  of  ideas 
for  more  sophisticated  application  is  tapped.  The  system  must  be  designed 
to  adapt  to  this  change  with  minimal  effort.  User  acceptability  rises 
dramatically  when  this  capacity  for  change  is  specified.  This  honing  of 
the  prototype  product  in  the  grit  of  user  application  and  modification  is  the 
means  by  which  the  ultimate  product  is  sharpened  and  shined  into  a highly 
effective  device. 

In  summary,  the  field  instructors  contribute  to  the  development  of  ad- 
vanced training  systems  by  providing  a statement  of  training  objectives,  by 
helping  to  establish  objective  performance  measurement  criteria,  by  offer- 
ing advice  on  training  methods,  and  by  suggesting  improvements  to  the 
existing  system  based  upon  their  experience. 

The  training  systems  analyst  takes  a fresh  look  at  the  training  prob- 
lem; specifically  defines  and  objectifies  training  requirements  to  be  ad- 
dressed; selects  all  that  is  valuable  from  existing  methods;  suggests  and 
even  sells  new  methods  and  problem  solutions;  supplies  a clear  statement 
of  the  functional  capability  requirements  of  the  proposed  system  to  the  hard- 
ware and  software  specialists;  and,  finally,  devises  and  executes  experi- 
ments to  establish  whether  or  not  training  requirements  are  met  and 
cost-effectiveness  enhanced  by  the  use  of  the  system. 

The  hardware  and  software  specialists  advise  on  the  technical  feasi- 
bility of  the  proposed  system;  uncover  areas  wherein  system  potential 
might  be  better  used;  suggest  the  use  of  new  technologies  where  appropri- 
ate; select  the  most  cost-effective  hardware  suite  needed  to  perform  the 
specified  tasks  with  due  regard  to  potential  added  capabilities;  and  design, 
implement,  and  test  a system  to  perform  the  tasks  specified. 


ASAC  Training  Analysis 


Unfortunately  ASAC  training  is  in  the  same  condition  now  that  AIC  train- 
ing was  in  a year  ago,  prior  to  development  of  the  course  structure  described 
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in  section  II.  ASAC  trainees  are  being  taught  equipment  rather  than  a job. 

A task  oriented  training  requirements  analysis  is  an  essential  step  prior  to 
the  development  of  an  effective  training  system  such  as  the  one  being  en- 
visioned for  AIC  and  ASAC.  Moreover,  a task  analysis  will  provide  greater 
visibility  to  NAVTRAEQUIPCEN 's  research  efforts  in  terms  of  identifying 
the  applicability  of  AIC- related  research  efforts  to  similar  aspects  of  the 
ASAC  problem. 

The  training  requirements  are  derived  at  the  functional  level  by  the 
application  of  the  principles  of  task  analysis.  Task  analysis  starts  with  the 
generic  or  broadscale  tasks  or  responsibilities  of  the  operator  and  utilizes 
a series  of  analytic  steps  to  explicate  all  the  task  elements  which  are,  in 
turn,  translated  into  learning  objectives.  These  objectives  are  stated  in 
behavioral  terms,  each  of  which  is  accompanied  by  a description  of  the 
conditions  under  which  the  behavior  is  performed  and  the  standards  to  which 
it  is  performed. 

At  the  present  time  the  AIC  training  community  has  completed  the  task 
analysis  through  the  level  of  enabling  objectives  down  to  the  level  of  ter- 
minal objectives;  that  is,  the  level  at  which  the  ultimate  level  of  proficiency 
expected  of  the  student  is  described.  In  addition,  as  described  in  section  II, 
these  objectives  have  been  sequenced  into  blocks  of  instruction  (for  eventvial 
presentation  to  the  student)  which  range  upward  in  calculated  levels  of  task 
difficulty.  Increasing  levels  of  difficulty  are  obtained;  by  stepwise  in- 
creases in  learning  task  complexity;  from  partial -to -full  scope  responsi- 
bility; from  single  to  increasing  numbers  of  targets  on  the  scope;  etc. 

These  analytic-task  listings  of  objectives,  conditions  and  standards 
have  not  been  developed  as  yet  by  the  ASAC  community.  Since  they  con- 
stitute the  backbone  reference  for  all  further  system  development  work, 
this  effort  should  be  initiated  as  soon  as  possible.  It  should  be  emphasized 
here  that  the  formal  ASAC  task  analysis  should  be  initiated  prior  to  final 
specification  of  the  AIC/ASAC  trainer.  Just  as  the  current  AIC  course  at 
FCTCP  is  benefiting  now  from  the  AIC  analysis,  so  too  can  current  ASAC 
training  receive  immediate  benefit  froma  thorough  and  complete  training 
requirements  exercise.  The  following  steps  are  intended  to  outline  recom- 
mended steps  for  accomplishing  this  effort.  They  are  based  on  both  Logi- 
con's  experience  and  upon  Navy  in-house  experience  with  the  derivation  of 
AIC  learning  objectives.  Implementation  of  these  tasks  could  easily  occupy 
a training  analyst  and  subject  matter  expert  (SME)  for  the  better  part  of  a 
year. 

Step  1;  Preparation  of  Research  Questions  — ASAC  responsibilities  are 
not  well  defined,  even  within  the  ASAC  community.  Previous  experience 
with  AIC  has  shown  that  the  best  solution  to  this  problem  lies  in  an  innovative 
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approach  to  task  analysis.  That  is,  rather  than  rely  exclusively  upon  tlie 
knowledge  and  experience  of  operationally  qualified  ASAC  SME's,  the 
effort  must  also  involve  the  cooperation  of  the  airborne  communities  ser- 
viced by  ASAC.  These  include  L.AMPS-HELO,  P-3  and  S-3.  The  joint 
definition  effort  starts  with  obtaining  concise  and  complete  statements  of 
what  each  of  these  user  communities  wants  or  expects  from  the  ASAC  con- 
troller in  the  operational  environment.  This  derived  information  must  be 
combined  with  the  information  already  available  within  the  ASAC  opera- 
tional community. 

This  effort  is  best  initiated  by  the  preparation  of  research  questionnaires 
to  be  submitted  to  each  of  the  communities  in  turn.  These  questionnaires 
must  include  a means  of  getting  at  all  the  types  of  information  required  (to 
be  integrated  with  information  existing  within  the  ASAC  community)  to 
establish  the  complete  set  of  ASAC  responsibilities. 

Step  2;  Interview  S-3,  P-3,  LAMPS,  and  Help  Communities  — This 
effort  is  required  for  the  user  communities  to  complete  the  questionnaires. 
Ehie  to  the  general  lack  of  definition  regarding  exact  ASAC  responsibilities, 
many  of  the  terms  contained  on  the  questionnaires  are  expected  to  generate 
controversy.  This  controversy  must  be  resolved  both  within  the  user  com- 
munities and  between  each  user  community  and  the  ASAC  community.  Both 
the  training  analyst  and  the  SME  play  important  roles  in  this  process  by 
guiding  the  investigation  into  each  item  of  responsibility  in  question. 

Step  3;  Compile  Research  Data  — The  interview  data  from  step  2 must 
next  be  compiled  and  ordered  for  review  by  all  interested  parties.  These 
processes  provide  an  orderly  framework  for  the  process  of  deriving  learn- 
ing objectives  from  the  listings  of  ASAC  responsibilities. 

Step  4;  Interview  TAO/ASAC  Communities/Determine  ASAC  Respon- 
sibilities  to  Tactical  Action  Officer  (TAP)  — This  step  is  similar  to  step  2, 
above.  ASAC  responsibilities  include  that  of  reporting  to  the  TAO  on  own- 
ship,  and  these  responsibilities  must  be  defined  as  a joint  effort  of  repre- 
sentatives of  each  of  the  two  communities.  The  questionnaire /interview 
technique  should  be  used  in  this  effort  as  it  was  for  establishing  the  resoon- 
sibilities  to  the  airborne  communities.  Roles  of  the  training  analyst  ana 
SME  are  similar  to  those  noted  in  step  2.  This  step  also  allows  time  for 
the  compilation  of  the  data  as  discussed  in  step  3 above. 

Step  5;  Development  of  Job  Performance  Task  Statements  — This  step 
consists  of  translating  all  responsibilities  data  into  concise  and  accurate 
statements  of  performance  requirements.  These  requirements  must  be 
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stated  at  the  mission/function  level  of  detail  and  must  include  all  functions 
upon  which  t .e  student  must  ultimately  be  trained.  Training  analyst/SME 
responsibilities  for  this  step  are  those  of  ensuring  that  all  compiled  data  arc 
eventually  stated  in  both  objective  and  operational  terms  and  that  the  final 
listing  of  requirements  is  complete.  Culmination  of  this  effort  results  in 
an  inventory  of  performance  requirements. 

Step  6:  Submit  Performance  Requirements  Inventory  to  User  Com- 
munities  — The  listings  or  inventory  of  performance  requirements  must  be 
submitted  to  each  of  the  user  coinmunities  for  a final  check  regarding  ac- 
curacy and  completeness.  Any  revisions  made  to  the  inventory  at  this  time 
must  be  a joint  effort  of  the  training  analyst  (or  SME)  and  a qualified  repre- 
sentative of  the  user  connmunity.  When  the  revisions  are  completed  and 
rechecked,  the  complete  listing  of  performance  requirements  must  be  sub- 
mitted to  training  analysts  and  SMEs  for  the  following  steps  to  be  completed. 

Step  7:  Select  Performance  Requirements  to  be  Taught  by  the  System/ 
Device  — This  effort  can  partially  overlap  that  of  step  6 and  in  fact,  may 
involve  the  same  personnel,  givena  joint  effort  of  both  the  ASAC  and  user 
communities.  The  selection  process  itself,  at  this  stage  of  the  program, 
will  be  determined  primarily  by  the  entry-level  qualifications  of  the 
students.  Performance  requirements  already  mastered  by  entry-level 
students  will  not  need  to  be  taught,  though  some  later  performance  measure- 
ment or  evaluation  on  these  requirements  may  be  advisable.  Primary 
responsibility  in  this  step  will  be  borne  by  the  SME  who  will  rely  upon  both 
ejtperiences  and  technical  advice  of  the  training  analyst. 

Step  8;  Conduct  Task  Analysis  — Either  Instructional  Systems  Develop- 
ment (ISD)  or  Systems  Approach  to  Training  (SAT)  techniques  are  required  for 
the  completion  of  this  effort,  which  consists  of  analyzing  job  performance  require- 
ments in  terms  of  functions,  task-within-functions  and  task-eleinents-witlun- 
tasks.  The  analysis  continues  until  every  element  of  every  cask  is  specified,  at 
which  point  the  data  are  translated  into  learning  objectives.  These  objec- 
tives are  stated  in  terms  of  knowledge,  skills,  conditions,  and  standards 
ul  pt'i  lonnanco,  and  may  be  specified  in  a number  of  ways,  such  as  ter- 
lumal  objectives  and  associated  enabling  objectives.  Moreover,  they  are 
stated  in  behavioral,  observable  terms.  The  output  of  this  step  must  be  a 
complete  listing  or  inventory  of  all  items  of  performance  to  be  taught  within 
the  training  course  itself.  Each  of  these  items  must  be  accompanied  by  a 
statement  of  the  conditions  under  which  it  must  be  performed  and  the  stand- 
ards to  which  it  must  be  performed.  The  role  of  the  training  analyst  is 
primary  in  this  task,  insofar  as  he  must  specify  the  procedures  for  the 
analysis  itself,  as  well  as  those  required  to  translate  the  task  elements  into 
learning  objectives.  The  analytic  task  is  greatly  facilitated,  however,  if 
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he  has  access  to  the  operational  expertise  of  the  SME,  who,  by  this  point 
in  the  project,  will  have  developed  a familiarity  with  the  procedures  and 
techniques  of  task  analysis.  Under  these  optimal  conditions  the  analyst 
and  SME  can  function  jointly  or  independently. 

Step  9;  Instructional  Sequencing  and  Blocking  — This  step  is  of  critical 
importance  in  aligning  the  ASAC  program  with  that  of  the  AIC.  By  way  of 
explanation,  the  joint  AIC/ASAC  trainer  is  expected  to  have  both  automated 
and  adaptive  instructional  features  as  well  as  speech  recognition/ gene  ration 
capabilities.  Since  the  trainer  itself  will  constitute  the  primary  learning 
medium  for  the  entire  training  system,  it  is  reasonable  at  this  point  to 
sequence/block  the  learning  objectives  in  accordance  with  what  is  known 
about  the  trainer.  Learning  objectives  for  the  AIC  program  have  already 
been  sequenced  from  the  simple  to  the  complex,  and  in  increasing  levels 
of  task  difficulty,  in  accordance  with  the  adaptive  features  of  the  projected 
system.  They  are  specified  in  objective /quantitative  terms  and  are  ac- 
companied by  appropriate  voice  communication  requirements  in  accordance 
with  the  other  instructional  features  of  the  projected  system.  Once  derived, 
the  ASAC  learning  objectives  must  be  sequenced  in  the  same  manner  in 
order  to  ensure  that  the  training  programs  can  share  the  instructional 
features  of  the  system.  The  similarities  of  AIC  and  ASAC  operational 
responsibilities  and  the  set  of  instructional  features  to  be  provided  on  the 
joint  trainer  constitute  the  basis  of  justification  for  the  commonality  of 
training.  These  must  be  carefully  defined  in  order  for  both  controller 
communities  to  obtain  maximum  benefits  from  the  trainer. 

This  step  will  require  extremely  close  cooperation  between  the  training  ana- 
yst  and  SMEs.  At  least  1 SME  is  required  from  each  of  the  two  controller 
communities  in  order  to  provide  a balanced  merger  of  the  common  training 
requirements  to  be  addressed  by  the  joint  trainer. 

Step  10;  Media/Training  Aid  Selection/Specification  — For  present  pur- 
poses the  media  selection  process,  which  is  normally  a major  and  formal- 
ized effort  within  the  framework  of  ISD,  need  address  most  specifically  the 
separation  of  those  performance  items  to  be  presented  on  the  joint  trainer 
from  those  which  are  not.  Though  the  final  detailed  specification  of  the 
trainer  is  not  possible  until  further  R&D  efforts  have  been  accomplished, 
enough  data  will  be  available  at  the  conclusion  of  the  task  analysis  for  a 
reasonable  approximation  to  be  made  regarding  which  performance  items 
arc  likely  to  be  implemented  on  the  trainer. 

At  the  same  time,  a formal  media  selection  process  can  be  implemented 
regarding  other  training  media  to  be  used,  such  as  classroom  lecture, 
sound- slide  and  video-tape,  etc.  Complete  definition  of  this  formal  process 
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is  beyond  the  scope  of  the  present  report.  Suffice  to  say  it  must  be  initiated 
at  some  point  after  the  derivation  of  the  total  set  of  learning  objectives. 

In  general,  the  role  of  the  training  analyst  is  primary  in  the  definition  of 
media  requirements  insofar  as  these  must  be  based  upon  the  nature  of  the 
learning  objectives.  Heavy  reliance  must  be  placed  as  usual,  however, 
upon  the  operational  expertise  of  the  SME. 

Step  11;  Development  of  Student  Handout  and  Supervisor  Written 
Material  — Completion  of  this  task  results  in  the  development  of  all  necessary 
supporting  textual  information  for  the  training  program.  At  the  completion 
of  training  the  accomplished  student  will  have  assimilated  a well-defined 
repertoire  of  knowledge  items  and  skills  which  prepare  him  for  operational 
responsibilities.  This  step  is  on  the  side  of  the  knowledge  items  he  must 
possess  to  accomplish  the  various  tasks.  In  general  terms  these  items 
directly  support  the  verbal  and  motor  skills  required  and  are  considered  to 
be  acceptable  for  inclusion  into  the  program  only  if  they  are  need-to-know 
(as  opposed  to  nice-to-know)  items.  Also  in  general  terms,  these  items 
usually  consist  of  theoretical  and/or  background  types  of  information  not 
amenable  to  treatment  by  "hands-on"  training  devices. 

Primary  responsibilities  for  developing  these  materials  rest  with  the  SME 
who  is  uniquely  qualified  to  know  specifically  which  information  is  required 
for  the  successful  completion  of  controller  tasks.  Structuring  and  format- 
ting of  the  information  is  more  within  the  province  of  the  training  analyst, 
though  the  entire  effort  must  be  accomplished  jointly. 

Step  12:  Conduct  Pilot  Course  for  Students  and  Instruction  Staff  — This 
step  requires  the  cooperation  of  both  the  students  and  instructional  staff 
and  is  intended  to  validate  the  learning  objectives,  structure,  media  etc.  , 
for  the  entire  curriculum.  For  present  purposes  the  major  concern  will  be 
the  subset  of  learning  objectives  and  other  factors  which  are  specific  to  the 
projected  AIC/ASAC  trainer.  Optimal  results  will  be  obtained,  however, 
only  with  the  validation  of  the  entire  program,  the  complete  discussion  of 
which  is  outside  the  scope  of  the  present  effort. 

Analysis  of  the  data  obtained  in  this  step  will  be  a joint  effort  of  the  training 
analyst,  SME,  students  and  instructional  staff.  Results  of  the  analysis  it- 
■solf  will  be  provided  as  input  to  the  following  step. 

Step  13;  Revisions  and  Update  of  the  Curriculum  — This  step  requires  the 
cooperation  of  the  students  and  instructional  staff  and  is  intended  to  feed 
the  results  of  the  previous  step  into  the  training  program  for  the  purposes 
of  refinement.  In  some  instances  several  iterations  of  this  and  the  previous 
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step  are  required  before  the  instructional  curriculum  is  finalized.  Experi- 
ence with  AIC  indicates,  however,  that  a reasonably  reliable  definition  of 
the  curriculum  may  be  obtained  from  the  results  of  one  pilot  course  and 
revision/update,  although  the  development  of  an  optimal  curriculum  is  a 
continuing  evolutionary  process. 

Primary  responsibilities  for  this  effort  are  jointly  shared  by  the  training 
analyst  and  SME.  Additional  responsibilities  are  those  associated  with  the 
revision  and  update  of  the  textual  material  identified  instep  12. 


Step  14:  Submit  Revised  Course  Curriculum  and  Begin  New  Course  — 
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SECTION  VI 

THE  NTEC  PROTOTYPE  TRAINING  RESEARCH  SYSTEM-ACTS  I 

1 

Introduction  i 

The  general  goals  of  NAVTRAEQUIPCEN's  research  program  are  fairly 
well  understood,  and  surely  certain  aspects  of  the  AIC  training  program 
clearly  require  well  defined  R&D  effort  prior  to  production  of  the  eventual 
training  device.  These  areas  were  broadly- scoped  and  studied  during  the 
present  effort. 

But  the  more  specific  and  detailed  requirements  of  the  research  pro- 
gram, especially  when  viewed  as  the  experimental  prototype  of  the  AIC/ 

ASAC  trainer,  are  not  as  clear,  and  indeed  are  perhaps  still  undefined. 

Consequently  it  has  been  necessary  to  avoid  the  temptation  to  "over- spec" 
the  research  training  system^  at  this  early  date,  since  clearly  this  would  be 
premature  when  the  research  objectives  are  not  completely  understood  and/ 
or  defined,  let  alone  validated  against  the  AIC /ASAC  trainer  development 
program  and  the  always  present  time/cost  constraints.  Questions  have 
arisen  such  as;  "Should  the  R&D  program  be  concerned  with  motor  skill 
development?  or  "Should  the  research  be  conducted  using  operational 
NTDS  components,  e.  g.  , the  UYA-4  console?";  or  "Can  the  research  ob- 
jectives be  met  by  studying  only  levels  1—6  and  level  12  — 13?  ",  Defini- 
tive answers  to  these  questions  at  this  time  would  be  clearly  presumptvious, 
although  pro  and  con  discussions  are  certainly  in  order.  In  this  particular 
section,  therefore,  we  wish  to  stimulate  thought  and  discussion,  present 
the  clearly  defined  material,  but  at  the  same  time  not  imply  that  we  have 
all  the  answers. 

The  section  is  organized  as  follows.  Following  this  introduction  the 
general  goals  of  ACTS,  as  currently  understood,  are  described.  The  areas 
of  speech  recognition,  performance  measurement,  and  the  AIC  controller 
model  are  discussed.  We  then  reiterate  the  need  to  carefully  define  and 
validate  the  specific  R&D  objectives  for  this  large  program.  Using  the 
question  of  NTDS  participation  as  an  example,  a training  system  divorced 
from  NTDS  and  the  UYA-4  console  is  described.  This  discussion  is  fol- 
lowed with  the  arguments  for  utilization  of  the  console.  A compromise  is 
described  which  essentially  suggests  using  commercial  graphics  for  early 
development,  but  the  NTDS  console  for  final  integration  and  evaluation. 

Specific  recommendations  (one  of  which  will  be  a formal  training  research 
requirements  analysis/ validation/ review  effort)  are  discussed  in  the  final 
section  of  the  report. 
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The  Purpose  and  Coals  of  ACTS 

The  previous  section  described  the  need  to  lake  a long,  hard  look  at 
existing  training  systems  and  to  develop  fresh  approaches  to  the  training 
problems,  aided  now  by  advances  in  technology,  methodology,  and  training 
system  design.  The  advantages  of  "automated-adaptive"  training  systems 
for  aircraft  pilots  and  weapons  officers  have  been  established  for  some 
time.  Only  recently,  however,  have  these  techniques  been  applied  to  con- 
troller training  tasks.  The  GCA  controller  training  system  being  developed 
by  NAVTRAEQUIPCEN  is  in  fact  the  first  integration  of  objective  perform- 
ance measurement,  adaptive  syllabus  control,  computer  assisted  coaching, 
etc.  in  a controller  training  system.  The  development  of  this  laboratory 
tool  has  been  made  possible  by  the  emergence  of  reliable  speech  recognition 
technologies. 

The  development  of  the  AIC/ASAC  trainer  should  be  preceded  by  a 
similar  prototype  effort  which  addresses  the  application  of  speech  recog- 
nition and  automated-adaptive  training  strategies  to  the  air  control  training 
problem.  The  AIC  (and  presumably  ASAC)  tasks  are  significantly  different 
than  the  GCA- PAR  tasks;  and  while  the  experience  and  design  guidelines 
learned  during  the  GCA-CTS  program  will  of  course  be  useful  and  impor- 
tant, further  R&D  is  required. 

Given  the  desire  to  incorporate  advanced  training  methodology  into  the 
AIC/ASAC  trainer,  then,  the  purpose  of  ACTS  is  to  examine  in  detail  some 
nontrivial  aspects  of  the  total  air  control  training  problem,  to  develop  de- 
tailed design  guidelines,  and  further  develop  the  needed  technologies  which 
will  ensure  an  effective  air  controller  trainer  during  the  1980's.  In  general 
terms,  NAVTRAEQUIPCEN  will  gain  preproduction  experience  in  the  appli- 
cation of  the  following  elements  to  the  AIC  training  problem: 

a.  The  automated  speech  technologies:  Speech  recognition  and  speech 
generation  (though  the  latter  represents  low  technical  risk). 

b.  Objective  performance  measurement:  Based  upon  a model  of  cor- 
rect controller  behavior,  the  performance  of  the  student  can  be  measured 
and  compared  to  established  standards. 

c.  Teaching  strategies:  Given  that  the  student's  performance  is 
available  (known)  to  the  system,  various  techniques  can  be  applied  to 
develop  a training  system  uniquely  tailored  to  the  strengths  and  weaknesses 
of  the  individual  trainee  (e.g.  , syllabus  control,  remedial  coaching,  feed- 
back, etc.  ). 
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Development  of  .Spcct)i  llccoj'nition  Teclmiquos 

Recall  that  typical  AIC  vo<  abulary  was  presented  in  section  III  of  this 
report,  together  with  some  general  conclusion:  about  the  feasibility  of  auto- 
matically recognizing  this  vocabulary  using  state-of-the-art  and  projected 
computer  speech  recognition  systems. 

An  established  goal  of  NAVTRAEQUIPCEN' s research  program  is  to 
develop  a recognition  capability  that  will  support  AIC  training  in  an  effec- 
tive way.  The  definition  of  "effective"  remains  to  be  resolved,  but  never- 
theless it  is  possible  to  discuss  areas  of  development  which  will  almost 
surely  need  to  be  addressed  during  the  course  of  the  R&D  program. 

Basic  Limited  Continuous  Speech  Recognition  (LCSR)  — A significant 
amount  of  information  transmitted  to  the  pilot  is  represented  by  numerical 
data.  It  is  entir  ely  unreasonable  to  expect  the  AI<"  trainee  to  pause  between 
every  digit  in  tht  se  reports.  The  ability  to  recognize  strings  of  digits 
(usually  three  digits)  is  essential.  As  mentioned  in  section  III,  NAVTRA- 
EQUIPCEN  is  currently  funding  such  a development  effort,  and  this  pro- 
gram should  continue. 

Expanded  LCSR  — Regardless  of  the  eventual  content  of  the  RbD  pro- 
gram (in  terms  of  the  AIC  tasks  which  will  be  studied)  a basic  LCSR  capa- 
bility as  described  above,  plus  isolated  word  recognition,  plus  forced 
stylizations,  will  result  in  a minimally  acceptable  training  environment. 

By  expanding  the  LCSR  vocabulary  beyond  the  ten  digits,  however,  a signi- 
ficantly more  acceptable  system  will  result.  Table  1 1 suggests  an  ex- 
paned  LCSR  vocabulary  which  would  iner  Base  the  effectiveness  of  speech 
recognition  in  an  AIC  training  environmeut. 

The  feasibility  of  developing  such  a recognition  capability  should  be 
studied.  It  may  be  possible  to  combine  smaller  sets  of  vocabulary  words 
together  with  syntax  rules  to  effectively  limit  the  vocabulary  size  to  a 
branching  factor  of  10  — IZ.  If  this  were  the  case,  one  might  argue  that 
a successful  basic  LCSR  system  portends  the  successful  development  of  an 
expanded  LCSR  capability. 

Word  Spotting  — Depending  upon  the  specific  functional  requirements 
of  ACTS  (which,  in  turn,  will  depend  upon  identified  research  objectives) 
a word  spotting  capability  may  prove  to  be  a required  outgrowth  of  NAV- 
TRAEQUIPCEN's  R&D  program.  The  total  AIC  vocabulary,  unlike,  for 
example,  the  GCA/PAR  vocabulary,  does  not  consist  solely  of  specific 
(even  loosely  defined)  phraseology.  The  AIC  must,  for  example,  identify 
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TABLE  11.  EXPANDED  LCSR  VOCABULARY. 


zero 

point 

squawk 

one 

bogey 

twenty 

two 

stranger 

thirty 

three 

port 

forty 

four 

starboard 

fifty 

five 

vector 

sixty 

six 

breakaway 

seventy 

seven 

tracking 

eighty 

eight 

speed 

ninety 

nine 

altitude 

an  emergency  condition  and  inform  the  TAO,  No  specific  phraseology  is 
defined,  and  there  appears  to  be  reluctance  among  the  instructors  to  force 
predefined  phrases  upon  the  student.  The  training  system  may  only  need 
to  know  that  the  AIC  is  indeed  reporting  the  emergency.  Spotting  the  word 
"emergency"  in  a long  utterance  may  be  sufficient.  Fortunately  the  speech 
recognition  research  currently  being  sponsored  by  NAVTRAEQUIPCEN 
will  yield  insights  into  the  word  spotting  problem.  Again,  depending  upon 
the  definitization  of  ACTS  functions,  this  is  another  area  that  should  be 
investigated. 

Isolated  Word  Recognition  (IWR)  - IWR  will  continue  to  play  an  import- 
ant role  in  the  AIC  training  research  system.  The  AIC  vocabulary  does 
consist  of  perhaps  as  many  as  one  hundred  definable  phrases  that  are  (or 
can  be  reasonably  made  so)  isolated  on  both  ends  by  silence.  Problems  arise 
in  the  utilization  of  vocabulary  sizes  this  large,  however.  Most  significant 
is  the  problem  of  configuring  the  recognition  system  to  the  voice  data  pat- 
terns associated  with  each  vocabulary  item.  As  the  vocabulary  size  grows, 
the  problem  of  effectively  integrating  the  voice  data  collection  process  into 
the  total  training  scenario,  becomes  more  complex. 

Combining  IWR  with  LCSR  is  also  an, area  that  will  have  to  be  addressed 
in  the  R&D  program.  Some  stylization  will  almost  surely  be  required.  The 
development  goal  will  be  to  define  these  stylizations  in  a way  which  allows 
for  the  most  natural  speaking  styles;  and  to  define  techniques  to  teach  the 
student  these  stylizations  without  unnecessary  hardship. 
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Development  Schedule.  The  development  of  all  the  various  speech 
recognition  techniques  that  are  seen  (at  this  time)  as  enabling  or  enhancing 
the  AlC  training  situation,  will  constitute  an  important  and  sizeable  por- 
tion of  the  ACTS  program.  But  because  of  the  technical  risks  associated 
with  some  of  these  recognition  techniques,  together  with  the  difficulty  of 
accurately  predicting  a development  schedule(^),  the  following  approach 
might  be  considered. 

The  speech  recognition  portion  of  ACTS  can  be  designed  to  be  a self- 
standing module  within  the  whole  system,  just  as  the  Speech  Understanding 
Subsystem  (SUS)  was  designed  in  the  GCA-CTS.  By  doing  so,  the  entire 
training  research  system  could  be  developed  independently  of  the  speech 
recognition  functions.  An  IWR  capability  with  extreme  stylizations  could 
be  used  during  development  of  the  performance  measurement,  exercise 
control  and  other  subsystems.  The  recognition  work  would  proceed  in 
parallel  to  this  effort.  As  new  recognition  techniques  become  available, 
they  could  be  integrated  into  ACTS  in  piecemeal  fashion,  with  only  minimal 
impact  on  the  design  of  other  system  elements. 

Performance  Measurement 

In  addition  to  development  of  computer  based  speech  recognition,  an 
important  element  of  NAVTRAEQUIPCEN' s prototype  effort  will  be  devel- 
opment of  a performance  measurement  subsystem  for  the  air  intercept 
controller. 

Performance  measurement  implies  that  some  aspect  of  the  controller's 
behavior  can  be  monitored  by  the  system  (the  function  facilitated  by  speech 
recognition);  that  some  standard  against  which  to  measure  the  student's 
performaiice  can  be  defined  (the  function  of  the  controller  model  described 
in  the  following  subsection);  and  finally  that  some  yardstick  is  available 
for  performing  the  actual  rreasvirement  (the  function  of  a scoring  model, 
not  specifically  addressed  in  this  study). 

A basic  consideration  in  the  specification  and  design  of  the  performance 
measurement  subsystem  is  the  depth  to  which  automated  measurement  is 
effective.  AIC  instructors  at  FCTCP  have  expressed  the  fear  that  the  sys- 
tem may  be  over-complicated  by  attempting  to  measure  every  minute 


Sec  section  VII  for  preliminary  estimates. 
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controller  function.  Instead,  they  suggest  that  the  system  sample  only  the 
final  decisions  and  outputs  of  the  trainee.  In  other  words,  for  example, 
verify  that  the  student  issues  a stranger  report  in  an  accurate  and  timely 
manner,  rather  than  monitoring  each  of  the  dozen  or  so  steps  that  must 
be  executed  prior  to  issuing  the  report.  If  the  output  is  not  correct  or 
timely,  the  FCTCP  instructors  feel  that  the  trainee  knows  what  he  did 
wrong  (at  least  in  general  terms)  99  percent  of  the  time.  The  automated 
performance  monitoring  system  should  simply: 

a.  Make  known  the  mistake,  with  the  option  of  continuing  unless 
safety  is  involved;  and/or 

b.  Give  the  trainee  a chance  to  exercise  the  particular  problem  area 
again  without  going  through  the  entire  problem. 

c.  Provide  and  monitor  a remedial  exercise  to  ensure  compliance 
with  standards. 

When  the  function  of  the  performance  measurement  system  is  viewed 
in  this  way,  an  apparent  development  approach  is  to  examine  just  the  ter- 
minal objectives  and  associated  standards,  listed  in  section  II  of  this 
report,  and  suggest  that  they  constitute  the  basis  for  the  controller  model 
and  scoring  model.  If  a more  detailed  performance  measurement  system 
is  required,  then  the  controller  model  must  be  derived  from  both  the  ter- 
minal and  enabling  objectives,  supplemented  by  a more  detailed  representa- 
tive training  scenario.  These  subjects  are  discussed  at  length  in  the  fol- 
lowing subsection. 

Also,  given  that  performance  measurement  occurs  only  at  the  higher 
levels,  the  question  arises  as  to  the  extent  that  these  terminal  objectives 
can  be  monitored  entirely  by  understanding  the  controller's  verbal  behavior. 
Phrased  another  way,  to  what  extent  can  the  needed  performance  measure- 
ment system  be  based  solely  on  inputs  from  the  speech  recognition  system? 
A review  of  the  training  levels  show  that  levels  1 — 5,  7,  8,  10  — 12  can 
clearly  be  totally  monitored  using  only  the  speech  inputs.  A level  6 objec- 
tive (to  maintain  track  on  more  than  two  aircraft)  can  only  partially  be 
handled  by  voice  alone;  use  of  IFF  equipment  (level  9)  does  not  lend  itself 
to  speech  based  performance  measurement.  In  level  11,  updating  the  air- 
crew of  the  F-14  interceptor  via  one-way  data  link,  is  not  at  all  amenable. 

Despite  these  few  exceptions,  a remarkable  proportion  of  the  AIC  tasks 
can  be  effectively  monitored  at  the  highest  level  solely  by  observing  the 
verbal  transmissions.  This  augers  well  for  the  ultimate  success  of  a 
speech-based  AIC  automated -adaptive  training  system. 
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Another  consideration  regarding  performance  measurement  and  its 
relation  to  monitoring  system  parameters,  is  the  distinction  between  evalu- 
ating the  student  and  providing  remedial,  diagnostic  help.  Wl.ile  it  may  be 
sufficient  to  observe  the  trainee's  verbal  behavior  at  the  terminal  objective 
level  to  determine  that  he  has,  or  has  not,  performed  the  task  properly; 
it  may  be  necessary  to  observe  the  trainee  to  really  adequately  determine 
precisely  why  he  performed  the  task  improperly.  If  detailed  diagnostics 
are  indeed  required  and  are  of  interest  to  NA VTRAEQUIPCEN's  research 
program,  then  a detailed,  performance  measurement  system  may  be  required. 

A final  consideration  regarding  performance  measurement  involves 
the  extent  to  which  it  can,  or  should,  augment  and  support  speech  recogni- 
tion. An  important  feature  of  the  GCA-CTS  is  the  interface  between  the 
performance  measurement  subsystem  (PMS)  and  speech  understanding  sub- 
system (SUS).  Similar  design  could  be  useful  in  the  AIC  environment.  The 
extent  that  data  available  to  the  PMS  could  support  the  SUS  may  depend 
upon  the  level  at  which  performance  measurement  occurs.  This  is  an  area 
that  must  be  more  fully  investigated  in  the  early  phases  of  NAVTRAEQUIP- 
CEN's  research  program. 

The  AIC  Model  Controller 

The  ACTS  functional  requirements  must  be  derived  from  AIC  training 
requirements.  At  this  time  these  training  requirements  have  been  defined 
in  terms  of  terminal  level  training  objectives  and  supporting  enabling  ob- 
jectives. Their  analytic  level  of  detail  is  at  the  function/task  level,  and 
they  are  further  supported  by  the  specification  of  conditions  and  standards 
of  performance  for  each  of  the  terminal  objectives. 

Given  the  case  that  a training  system  already  exists  to  provide  a means 
for  meeting  learning  objectives,  it  is  useful  to  structure  these  objectives 
into  a controller  model;  that  is,  a model  of  the  controller's  behavior  as  he 
is  engaged  in  performing  his  task  responsibilities.  In  the  case  that  some 
aspects  of  the  student's  performance  are  subject  to  measurement,  evalua- 
tion or  .scoring /grading  by  computer-based  technology,  it  is  also  necessary 
to  define  a codable  model  of  controller  behavior.  In  addition,  performance 
conditions  and  standards  must  be  incorporated  with  scoring  and  weighting 
algorithms,  reference  points,  etc.  in  order  to  define  a computer  grader  or 
scoring  nunlel  for  assessing  student  performance.  Given  the  case  that  no 
training  system  exists,  these  steps  and  others  must  be  accomplished,  for 
the  systematic  specification  of  the  desired  system. 
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Definition  of  Controller  Model  — "Controller  model"  can  be  translated 
as  "Codable  model  of  controller  behavior,  " as  noted  in  the  above  paragraphs. 
Its  purpose  is  to  provide  a basis  for  communication  between  computer  pro- 
grammers and  training  psychologists.  The  phychologist' s job  in  this 
respect  is  to  look  at  performance  requirements  and  their  derived  learning 
objectives.  He  must  determine  that  the  appropriate  learning  objectives 
have  been  derived  from  the  correct  performance  requirements.  The 
learning  objectives  along  with  their  associated  conditions  and  standards 
constitute  the  controller  model  at  the  functional  level.  When  these  learn- 
ing objectives  are  codable  (programmable)  they  constitute  the  codable 
model. 

It  is  important  to  know  that  at  this  level  of  definition,  controller  model 
is  defined  exclusively  in  terms  of  the  characteristics  of  the  performance 
data,  not  in  terms  of  characteristics  of  the  system.  Characteristics  of 
the  performance  data  which  qualify  it  as  codable  are; 

a.  Objectivity  — The  data  can  be  directly  pointed  to  as  opposed  to 
being  inferred  or  otherwise  subjectively  treated. 

b.  Quantifiability  — The  data  are  subject  to  numeric  treatment  or 
measurement  (in  some  units  of  measure). 

c.  Digitizability  — The  data  are  specifiable  in  such  a way  as  to  be 
subject  to  treatment  by  digital  computer-based  technology. 

d.  Discreteness  — The  digital  data  associated  with  one  performance 
task  are  distinguishable  from  those  associated  with  another  performance 
task  (e.g.  , start  and  stop  points  are  clearly  specificable  for  each  separate 
task  to  be  trained,  measured,  evaluated,  etc.  ). 

Thus,  in  the  strictest  sense,  the  controller  model  is  a codable  model 
of  controller  behavior,  is  independent  of  any  system,  yet  at  the  same  time, 
is  subject  to  a wide  range  of  possible  treatments  by  digital- computer-based 
systems.  Among  these  treatments  are: 

a.  Performance  monitoring  — observing  student  behavior  only. 

b.  Performance  monitor  and  measurement  — observing  and  making 
low-grade  decisions  (e.  g.  , did  he  complete  the  task?  ). 

c.  Performance  monitoring,  measurement  and  evaluation  — observing, 
making  decisions  and  scoring  or  grading  performance. 

d.  Performance  prompting,  feedback,  measurement,  monitoring, 
evaluation,  etc. 
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[ 


e.  Beyond  the  provision  of  purely  monitoring  capabilities,  data  dis- 
play and  formatting  capabilities  must  be  addressed  — such  considerations 
involve  systems  specifications  in  terms  of  CRT's,  hardcopy,  and  other 
capabilities. 

Once  completed,  in  detail,  the  controller  model  constitutes  the  com- 
plete set  of  stimulus  response  elements  upon  which  the  functional  specifi- 
cation of  the  proposed  system  may  be  based.  Integration  of  these  elements 
with  the  specific  R&D  goals  of  the  system  as  established  by  NAVTRAEQUIP 
CEN,  provides  a virtually  complete  data  base  for  system  specification. 

' I 

I j 

^ ' Representative  Scenarios;  Derivation  of  a Controller  Model  — The 

first  approximation  to  a precise  definition  of  a complete  controller  model 
j j (including  enabling  objectives)  must  start  with  the  existing  task  listings, 

j ■ From  this  start  point,  a proven  approach  from  the  perspective  of  system 

I specification  is  to  structure  the  objectives  into  a time  lined  sequence  of 

' events  about  which  a typical  or  representative  training  scenario  may  be 

structured. 

[ This  representative  scenario  must  include  all  the  stimulus  and  response 

^ elements  associated  with  the  AIC's  performance  of  his  responsibilities,  and 

I must  be  referenced  to  an  operational  performance  baseline.  Thus,  starting 

I with  existing  terminal  objectives  in  their  appropriate  operational  sequence, 

[j  the  effort  consists  of  supplying  the  missing  detail,  particularly  that  associ- 

il  ated  with  the  training  or  exercise  environment.  When  these  relevant  stimuli 

and  target  response  elements  have  been  specified  in  detail,  and  the  irrelevant 
; or  noise  stimuli  (which  may  interact  with  relevant  stimuli)  also  have  been 

specified,  then  it  becomes  possible  to  design  an  effective  means  of  eliciting 
the  AIC's  behavior  when  the  relevant  stimuli  is  present.  For  simple  tasks, 
this  may  involve  explaining  the  concept  to  the  student,  then  affording  him 
with  practical  applications  of  the  concept.  For  more  complex  tasks,  good 
training  may  be  facilitated  by  simplifying  the  introductory  problems  so  that 
only  relevant  stimuli  are  presented.  As  the  trainee  masters  the  concepts, 
the  irrelevant  stimuli  normally  present  in  the  environment  can  be  phased  in 
adaptively,  notably  those  stimuli  which  serve  as  distracting  influences.  The 
difficulty  of  the  assigned  task  depends,  in  part,  upon  the  nature  of  the  ir- 
relevant stimuli  presented.  A measure  of  the  influence  of  these  factors 
therefore  contributes  to  the  decisions  made  by  the  instructor  model  and  to 
the  scores  calculated  by  the  grader. 

In  this  way  each  operator  action  is  located  within  a completely  defined 
contextual  framework  consisting  of  all  the  salient  features  of  the  training 
i environment.  In  behavioral  terms  the  completed  scenario  must  consist  of 

I both,  all  of  the  console  operator  responses,  and  all  of  the  system  supplied 

stimulus  elements  or  cues  to  which  the  responses  are  made.  In  the  absence 
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of  any  existing  system  the  complete  definition  of  all  the  stimulus  elements 
is  equally  as  important  as  the  definition  of  student  responses  because  it  is  a 
primary  function  of  the  system  itself  to  provide  the  total  stimulus 
environment. 

Some  of  the  detail  required  to  construct  a representative  training  sce- 
nario which  is  not  supplied  by  the  terminal  objectives,  may  be  supplied  by 
the  enabling  objectives.  In  some  cases,  enabling  objectives  may  be  con- 
stituted primarily  of  knowledge  items,  which  must  be  learned  in  order  for 
subsequent  behavioral  objectives  to  be  accomplished.  In  other  cases,  en- 
abling objectives  may  be  intermediate  level  behavioral  objectives  which 
support  the  accomplishment  of  later  objectives  (e.  g.  , terminal  objectives). 

In  the  existing  AIC  task  listings  enabling  objectives  are  noted  for  each 
of  the  terminal  objectives  listed.  However,  they  are  not  specified  in  enough 
detail  for  the  completion  of  a representative  scenario.  In  the  more  com- 
plex levels  of  training,  both  conditions  and  standards  of  performance  of 
these  enabling  objectives  remain  unspecified,  as  do  the  environmental 
(stimulus)  factors.  Though  conditions  and  standards  may  in  some  cases  be 
derived  by  referring  back  to  earlier  levels  of  training  in  the  task  listings, 
environmental  features  such  as  number  and  types  of  "targets"  on  the  radar 
scope  during  the  actual  performance  of  the  enabling  objective  remain 
undefined. 

Therefore,  in  order  to  support  the  complete  specification  of  a repre- 
sentative scenario,  enabling  objectives  must  be  analyzed  to  a finer  level 
of  detail  and,  where  they  are  behavioral  as  opposed  to  strictly  knowledge 
items,  must  be  associated  with  the  appropriate  conditions  and  standards. 

Implementation  of  the  proposed  system  will  ultimately  require  the 
definition  of  training  (or  research)  scenarios  which  are  appropriate  to  each 
level  of  task  difficulty  or  complexity  to  be  addressed  by  the  system.  How- 
ever, the  functional  specification  of  the  system  does  not  require  this  level 
of  effort  in  the  present  case.  Sequencing /blocking  strategies  utilized  for 
the  existing  listings  were  such  that  selected  learning  levels  contain  all  the 
essential  elements  of  preceding  levels.  Thus,  the  careful  selection  of  an 
appropriate  level,  and  the  subsequent  structuring  of  a detailed  scenario  for 
that  level,  will  provide  an  adequate  data  base  for  the  specification  of  sys- 
tem functional  capabilities. 

Defining  a Representative  Scenario  — The  level-of-training  appropriate 
to  the  definition  of  a representative  scenario  must  be  based  upon  specific 
R&D  goals.  Levels  11  and  12,  as  outlined  in  the  existing  AIC  course  task 
listings,  integrate  all  the  basic  skills  and  knowledge  accumulated  by  the 
student  into  complete  tasks  which  are  typical  of  those  required  for  opera- 
tional performance.  Thus,  all  the  basic  performance  items  are  represented. 
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Level  11  also  includes  representative  examples  of  shared  responsibil- 
ities among  two  or  more  AIC  students.  That  it  is  important  to  include  these 
shared  responsibilities  is  evidenced  by  the  fact  that  in  practice  AIC's  vir- 
tually never  work  alone.  Thus,  the  division  of  labor  in  a complex  exercise 
is  of  critical  importance  and  merits  consideration  as  a research  issue. 
NAVTRAEQUIPCEN  must  determine  early  on  if  their  research  interests 
extend  to  the  interaction  of  more  than  one  AIC  student.  If  so,  the  systeni 
design  must  encompass  the  multiple  student  case;  if  not,  the  above  3 steps 
may  be  considerably  simplified.  Preliminary  discussions  with  AIC 
instructors  indicate  that  the  training  level  selected  will  submit  equally  well 
to  the  development  of  either  single -student  or  two-student  scenarios. 

Though  the  single -student  scenario  would  require  considerably  less  com- 
plexity than  would  the  two-student  case,  the  level  of  training  would  remain 
the  same  with  regard  to  task  difficulty  and  complexity. 

Several  steps  are  required  to  complete  a representative  scenario  from 
level  1 1 of  training.  The  following  paragraphs  describe  the  culminating 
steps  in  the  development  of  a functional  specification  for  a computer  grader 
model.  This  grader  model  can  be  integrated  into  the  training  system  so 
that  it  has  the  capability  to  grade  performance  based  on  the  dynamic,  evolv- 
ing elements  of  the  real-time  simulation  of  the  total  environment. 

Step  1 — Specification  of  complete  set  of  concepts  to  be  learned  — the  descrip- 
tion of  each  concept  includes  the  enumeration  of  the  relevant  stimuli  or  con- 
ditions, the  rule  to  be  employed,  and  the  exact  behavior  to  be  performed, 
including  the  standards  to  be  met.  This  performance  may  involve  several 
task  elements  and  may  require  their  sequential  performance;  hence,  this 
required  sequencing  also  must  be  specified.  These  task  elements  may  in- 
clude operator  verbal  responses  which  must  be  similarly  specified.  If  altei- 
ative  responses  are  allowed,  they  also  must  be  specified. 

Step  2 — Specification  of  the  sequence  of  concept  presentation  — when  the  con- 
cepts to  be  learned  have  been  identified  and  their  associated  task  elements 
specified  in  detail,  their  interrelation  can  be  determined.  This  interrelation 
provides  the  basis  for  arranging  the  concepts'  presentation  in  accordance 
with  a step-by-step  concept  and  skill  acquisition  philosophy.  It  also  provides 
the  basis  for  the  design  of  automatic  remedial  problem  selection  logic. 

Step  3 — Specification  of  complete  set  of  scenario  environmental  factors  — 
this  step  consists  of  defining  the  characteristics  of  the  environment  to  which 
the  trainee  must  respond.  These  must  include  the  definition  and  description 
of  all  tracks  appearing  on  the  radar  scope,  time  of  appearance,  direction, 
velocity,  distracting  stimuli,  etc.  for  each  problem.  These  stimulus  events 
must  be  interspersed  with  the  operator  responses  noted  in  step  1,  above,  in 
their  proper  order  and  in  appropriate  relation  to  the  responses  themselves. 
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All  dependencies  and  contingencies  between  the  operator  responses  and  the 
stimulus  items  must  be  noted;  for  example,  given  that  the  AIC  student  con- 
ducts an  intercept  mission  correctly  such  that  the  interceptor  scores  a kill, 
the  "hostile"  video  is  faded  from  the  radar  scope.  It  should  be  noted  that 
this  scenario  is  not  the  operational  syllabus,  rather,  this  detailed  scenario 
is  required  for  specification  purposes,  i.  e.  , the  functional  design  of  the 
computer  grader  model  and  the  environmental  simulator.  The  actual  train- 
ing exercise  will  begin  with  a precise  environmental  set-up  similar  to  that 
defined  here.  Following  the  commencements  of  the  training  exercise,  the 
dynamic  situation  will  be  dependent  on  the  actual  responses  of  the  trainee. 

Step  4 — Specification  of  computer  grader  model  — the  completion  of  the  three 
tasks  noted  above,  in  effect,  provides  the  basis  for  the  specification  of  the 
model  controller  and  computer  grader.  What  remains  is  a final  selection  or 
verification  of  specifically  which  operator  task  performances  are  to  be  meas- 
ured and/or  evaluated,  development  of  scoring  criteria,  and  formatting  of  all 
the  data  for  maximum  utility  by  system  design  and  software  implementation 
personnel.  This  step  would  probably  best  be  accomplished  in  two  short 
phases,  the  first  being  that  of  selection  of  the  performance  items  to  be 
measured,  the  second  that  of  formatting  all  the  data.  The  end  product  of 
this  phase  would  be  a software  implementation  workbook. 

ACTS  Configuration 

As  noted  earlier,  specific  research  objectives  and  development  goals 
for  the  prototype  research  system  are  still  being  formulated.  This  precise 
delineation  of  the  most  effective  contributions  that  NA  VTRAEQUIPCEN's 
R&D  program  can  make  toward  the  eventual  production  of  the  AIC/ASAC 
trainer,  is  of  critical  importance.  Without  such  clearly  defined  and  stated 
objectives,  it  becomes  an  exercise  in  frustration  to  analyze  the  myrid  trade- 
offs that  are  a part  of  the  functional  and  design  specification  process. 

One  such  decision  known  to  be  of  concern  at  this  time,  is  centered  upon 
whether  or  not  to  use  the  existing  NTDS  student  console  in  the  experimental 
prototype  system.  One  alternative  to  using  the  NTDS  console  is  to  provide 
the  student  with  a modern  graphic  CRT  terminal  upon  which  various  AIC 
task  functions  may  be  simulated,  and  which  provides  some  means  by  which 
the  student  may  respond  to  the  simulation.  Another  approach  is  to  use  both 
types  of  consoles:  the  commercial  unit  for  system  development;  the  UYA-4 
for  system  evaluation. 


Since  this  decision  does  affect  system  configuration  radically,  the 
various  alternatives  are  discussed  in  the  following  subsections.  The  ap 
proach  taken  here  is  to  describe  the  types  of  problems  which  might  be 
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addressed  on  a CRT-graphics-based  system.  This  discussion  will  include 
an  example  of  the  types  of  training  problems  which  are  amenable  to  explor- 
ation on  the  CRT-graphics-based  system.  Following  this  discussion,  a 
rationale  will  be  provided  for  utilization  of  the  NTDS  console.  Finally,  the 
combined  console  approach  is  reviewed. 

Note  that  the  question  of  student  console  has  little  or  no  impact  on  the 
ACTS  goals  associated  with  exploring  the  automated  speech  tecnnologies. 


Non- NTDS  ACTS 


Introduction  — The  possibility  of  producing  an  AIC  training  system  which 
is  divorced  from  NTDS  and  the  UYA-4  console  is  investigated  in  the  following 
paragraphs.  A non-NTDS  based  system  would  have  use  in  the  experimental 
laboratory  for  investigating  aspects  of  cognitive  and  verbal  skill  acquisition, 
although  some  precautions  should  be  used  to  prevent  negative  transfer  if 
"real"  AIC  s are  part  of  the  subject  pool.  The  methods  which  prove  effective 
in  the  laboratory  could  then  be  implemented  on  the  operational  training  sys- 
tem. In  this  subsection,  one  particular  lesson  in  the  current  AIC  training 
program  is  examined  in  some  detail  and  suggestions  are  offered  for  imple- 
menting it  independently  of  NTDS  and  the  UYA-4  console.  The  discussion 
will  highlight  the  flexibility  that  this  approach  allows.  In  particular,  a plan 
is  suggested  for  training  the  cognitive  and  verbal  skills  which  are  acquired 
at  level  12  in  the  current  AIC  training  program.  These  tasks  are  broken 
down  into  their  component  parts  and  are  introduced  one  step  at  a time. 

Purely  synthetic  intermediate  steps  have  been  added  to  illustrate  the  fact 
that  novel  training  plans  can  be  implemented  easily. 

The  major  drawback  to  the  proposed  system  is  that  motor  skill  devel- 
opment is  not  addressed.  The  UYA-4  console  is  an  extremely  complicated 
piece  of  equipment  with  which  the  AIC  must  interact  constantly.  While  it  is 
possible  that  the  AIC's  performance  can  be  partitioned  on  a theoretical 
basis  into  verbal,  cognitive  and  motor  components,  no  such  simple  trichot- 
omy necessarily  exists  in  fact.  A system  such  as  this  one  which  focuses  on 
only  a part  of  the  learning  task  could  lead  to  biased  estimates  of  the  train- 
ing problem,  and  the  overall  contribution  to  training  effectiveness  is 
unclear.  Therefore  the  following  disctission  is  in  no  way  intended  to  under- 
mine the  Navy's  commitment  to  providing  training  experiences  in  a realistic 
environment. 

Assumptions  — The  system  described  is  intended  to  provide  training 
comparable  to  that  presently  provided  at  level  12,  but  restricted  to  the 
cognitive  and  verbal  aspects  of  that  training.  Therefore  the  system  de- 
scribed in  the  following  paragraphs  utilizes  a minicomputer-based  graphics 


90 


NAVTRAEWUIPCEN  77-M- 1058-1 


! simulation  of  the  radar  display.  The  problem  of  providing  a realistic  envi- 

I ronment  for  motor  skill  development  by  simulating  the  UYA-4  console  and 

[ the  NTDS  program  is  not  addressed. 

f The  AIC  must  learn  to  act  as  an  effective  member  of  a tactical  informa- 

tion team.  A complete  training  system  must  address  this  problem.  The 
performance  of  missing  team  members  can  be  simulated  with  techniques 
similar  to  those  for  simulating  the  pilot's  verbal  behavior  as  described  in 
the  following  paragraphs.  (Reference  to  such  an  approach  also  is  described 
in  Technical  Note  NAVTRAEQUIPCEN  TN-52.  ) This  aspect  of  training  is 
notemphasized  in  level  12  to  which  the  following  discussion  is  limited;  there- 
fore, no  provision  is  made  for  training  the  skills  needed  for  interacting  with 
other  controllers  (the  fire  control  personnel,  supervisory  personnel  etc,  ). 

Because  this  is  a laboratory  system,  and  because  the  problem  is  focused 
on  those  tasks  in  which  the  AIC  functions  autonomoulsy,  a single  station  con- 
figuration is  assumed  to  be  sufficient.  There  is  no  need  for  a multistation 
environment,  nor  even  a separate  instructor's  console. 

Finally,  throughout  the  discussion,  it  is  assumed  that  a speech  recog- 
nition capability  exists  which  can  recognize  the  controller's  instructions.  j 

The  problems  inherent  in  providing  this  capability  are  addressed  in  a sep- 
arate section. 

Hardware  Configuration  — The  following  paragraphs  describe  the  hard- 
ware components  of  a laboratory  version  AIC  training  system  designed  on 
the  foregoing  assumptions. 

The  Training  System  Controller  — The  training  system  controller  is  a 
commercial  minicomputer.  The  exact  specifications  of  this  controller 
depend  upon  the  processing  requirements  demanded  by  the  training  prob- 
lem, the  record  keeping  requirements,  and  the  peripheral  support  require- 
ments, Significant  contributing  factors  in  the  choice  of  the  controller 
include  the  extent  to  which  speech  and  graphics  display  processing  will  re- 
quire controller  resources. 

Disk  — Implementation  of  a sophisticated  real-time  training  system  on 
a minicomputer  is  made  possible  by  an  overlay  management  capability. 

This  requires  peripheral  support  in  the  form  of  a relatively  fast  access 

disk.  In  addition,  training  records  are  easily  maintained  on  disk.  Finally,  j 

the  simulation  of  many  tracks  on  a radar  display  is  probably  best  accom- 
plished by  means  of  table-driven  aircraft  and  vessel  simulations.  An  ex- 
tensive data  base  can  be  maintained  on  disk  to  provide  a variety  of  training 
problems. 
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Speech  Recognition  Equipment  — The  system  described  depends  upon  a 
speech  recognition  system  capable  of  recognizing  AIC  terminology  in  real 
time.  This  may  require  a processor  separate  from  the  training  system 
controller,  and  an  interface  between  the  two  processors. 


Graphics  Display  — A good  quality  refresh  graphics  display  terminal  is 
required  to  provide  the  simulated  radar  display  and  the  information  normally 
provided  by  NTDS.  In  the  system  described  here,  there  is  also  a console 
data  entry  requirement  which  demands  that  there  be  a provision  whereby 
the  student  can  convey  to  the  system  that  he  believes  he  is  in  contact  with  a 
specific  aircraft.  This  is  most  easily  accomplished  by  a light  pen  or  ball 
tab  data  entry  capability.  Finally,  since  the  one  display  unit  will  most 
likely  serve  as  both  the  instructional  console  and  system  development  termi- 
nal, it  must  have  an  alphanumeric  keyboard  associated  with  it. 

Speech  Generation  Unit  — The  AIC  is  in  constant  communication  with 
one  or  more  pilots.  The  pilots'  verbal  communication  will  be  simulated 
using  a speech  generation  unit  such  as  the  Votrax  or  perhaps  a fast  random- 
access  audio  playback  system.  While  it  is  not  absolutely  necessary  to 
provide  different  voices  for  each  pilot  since  the  pilot  gives  his  call  sign  with 
each  transmission,  it  would  be  a nice  feature.  The  programmable  variable 
pitch  option  on  the  Votrax  would  serve  the  purpose.  It  is  probably  not  nec- 
essary to  simulate  the  extraneous  communication  normally  present  on  the 
voice  channel. 

Printer  — A medium  speed  line  printer  is  required  for  training  system 
data  output  and  also  as  an  adjunct  to  training  system  development  work. 

Magnetic  Tape  Unit  — Magnetic  tape  is  an  inexpensive  data  storage 
medium,  and  is  almost  a necessity  in  any  development  system  for  routine 
disk  backup  maintenance. 

Foot  Pedal  Microphone  Activator  — The  AIC  selects  the  appropriate 
radio  channel  via  foot  pedal  actuators.  This  mechanism  should  be  provided  > 

in  the  training  system. 

Training  System  Capabilities  — A brief  description  of  some  of  the  im- 
portant capabilities  of  the  training  system  (exclusive  of  the  speech  recog- 
nition capability)  is  given  in  the  following  paragraphs. 

Radar  Display  Simulation  — A major  portion  of  the  graphics  display 
area  will  be  devoted  to  the  radar  simulation.  This  is  intended  to  be  a fairly 
simple  display  showing  the  tracks  in  the  system  and  perhaps  a very  simple 
landmark  display.  Although  there  is  no  need  to  fade  the  display  behind  the 
radar  sweep,  the  sweep  itself  provides  the  stimulus  which  elicits  some  of 
the  AIC's  verbal  behavior.  Therefore  a similar  stimulus  must  be  provided. 
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A simple  solution  is  to  provide  a dot  which  circles  the  periphery  of  the 
display  at  the  same  rate  the  radar  sweep  would.  The  effectiveness  of  the 
stimulus  would  have  to  be  determined  empirically. 

Symbols  — The  symbology  normally  available  over  the  radar  display 
must  be  provided. 

NTDS  Information  — A great  deal  of  information  is  available  to  the  AIC 
and  is  normally  retrieved  through  complex  interactions  with  the  UYA-4 
console.  Much  of  this  information  is  transmitted  to  the  pilot  over  secure 
voice  channels,  and  this  verbal  behavior  will  be  required  in  the  training 
system  described.  Since  there  is  no  simulation  of  the  UYA-4  console,  this 
information  will  always  be  displayed  on  the  graphics  terminal,  except  under 
simulated  radar  loss  conditions. 

Data  Entry  — A provision  must  be  made  for  specialized  data  entry  so 
that  the  AIC  can  effectively  point  to  specific  areas  on  his  radar  display.  In 
general,  this  method  will  be  used  to  inform  the  training  system  of  the  AIC's 
decisions  during  the  training  exercises,  A light  pen,  ball  tab  or  joy  stick 
would  provide  an  effective  data  entry  method. 

Tracks  — The  system  must  provide  a moderately  complex  display  of 
subsurface,  surface  and  airborne  tracks  including  missiles  in  order  to 
provide  the  fullest  range  of  training  experiences.  Several  modules  will 
contribute  to  this  primarily  table-driven  track  display.  A track  update 
module  will  utilize  the  current  set  of  parameters  associated  with  each  track 
to  update  its  position,  and  will  cause  that  update  to  appear  as  the  radar 
sweep  passes  through  the  track.  These  navigation  parameters  will  be  de- 
rived from  four  sources.  These  are  described  below  and  shown  in  figure  11: 

a.  Parameter  Update  Module  — A track  parameter  table  will  reside 
on  disk  and  be  the  primary  source  of  information  for  most  tracks.  It  will 
be  read  by  the  parameter  update  module.  The  track  position  information 
will  be  computed  on  the  basis  of  this  table  information  unless  one  of  the 
modules  described  below  takes  over  control  of  the  track.  The  table  pro- 
vides the  track  start  points,  then  the  relevant  navigation  information  such 
as  speed,  heading,  altitude,  etc,  A parameter  indicates  the  time  the  next 
change  ui  any  ol  the  paraniotcrs  is  to  bo  made  and  the  system  will  retrieve 
the  new  data  at  the  spt>.llied  time  by  means  of  the  parameter  update  module. 
Another  parameter  will  serve  as  an  indicator  which  specifies  whether  or 
not  tlie  track  will  respond  to  the  AIC. 

b.  Fighter  Pilot  Simulation  Module  — A copy  of  this  module  will  exist 
for  each  track  under  AIC  control.  As  soon  as  communications  have  been 
established,  this  module  will  take  control  of  the  track  fromthe  parameter 
update  module.  It  will  decipher  AIC  commands  and  cause  the  aircraft  to 
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respond  to  them  by  changing  the  aforementioned  parameters.  When  this 
module  detects  lock-on,  it  reports  this  to  the  AIC  and  gives  over  control 
of  the  track  to  the  Air  Attack  Module. 

c.  Air  Attack  Simulation  Module  — This  module  will  direct  offensive 
maneuvers  during  lock-on,  and  will  return  control  to  the  fighter  pilot  module 
for  breakaway  procedures. 

d.  Bogey  Jink  Module  — One  of  the  options  available  in  the  track 
parameter  table  will  allow  a hostile  track  to  come  under  the  control  of  the 
jink  module.  This  module  will  maneuver  the  track  to  counter  the  offensive 
being  marshaled  by  the  AIC. 

Other  Displays  — Special  Displays  are  required  during  training.  One 
example  is  the  intercept  track  display  described  for  step  3 of  level  12 
training. 

Level  12  Description  — Level  12  was  chosen  to  provide  an  illustration  of 
the  training  which  could  be  provided  given  the  preceding  constraints.  The 
completion  requirements  for  level  12  are  shown  in  table  12.  Of  these,  only 
those  numbered  7 and  8 involve  new  skills.  The  others  have  been  built  up 
systematically  in  previous  levels.  It  is  at  this  level  that  the  AIC  student 
has  his  first  experience  with  controlling  aircraft.  His  control  instructions 
are  actually  carried  out  by  pseudo-pilots  who  control  the  simulated  aircraft 
he  sees  on  his  NTDS  display.  The  purpose  of  this  level  is  to  give  him 
experience  in  controlling  "live"  aircraft,  to  teach  him  to  select  training 
set-ups,  and  to  enable  him  to  become  proficient  in  coordinating  practice 
set-ups  for  s^dent  pilots. 

The  Steps  — In  the  laboratory  training  system,  the  new  skills  required 
for  completion  of  level  12  will  be  built  up  gradually.  The  i.r te rmediate 
steps  are  specified  in  more  detail  than  is  given  in  the  current  training 
syllabus.  The  presentation  is  based  upon  hypothetical  constructs  about  the 
dynamics  of  skill  acquisition,  and  not  upon  a training  analysis.  Therefore, 
it  should  be  emphasized  that  the  actual  steps  chosen  are  not  meant  to  be 
used  as  the  training  system  specification.  Rather,  they  serve  to  illustrate 
the  capability  and  flexibility  of  the  described  system. 

The  new  tasks  required  for  completion  of  level  12  are  introduced  in  six 
steps,  listed  in  table  13.  Some  of  these  steps  are  purely  synthetic  in  the 
sense  that  the  system  provides  prompts  and/or  feedback.  As  complete  a 
description  of  these  steps  as  possible  in  this  unclassified  report  is  given, 
along  with  a brief  discussion  of  previously  acquired  skills. 

Baseline  Skills  — The  first  six  requirements  listed  in  table  12  represent 
skills  acquired  at  previous  levels,  and  mastery  of  these  is  assumed.  There- 
fore the  realistic  portions  of  the  exercise  will  be  conducted  in  a way  that 
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TABLE  12.  COMPLETION  REQUIREMENTS  FOR  LEVEL  12. 

1.  Properly  locate  assigned  aircraft  within  1 minute  after 
communications  established. 

2.  Transmit  target  data: 

a.  Magnetic  bearing  and  range  8 out  of  10  sweeps  ±2  degrees 
±2  miles. 

b.  Track  and  ground  speed  within  ±10  degrees  and  0.  1 Mach 
within  1-1/2  minutes. 

c.  Altitude  within  1-1/2  minutes. 

d.  Direction  of  jink  within  1 minute. 

3.  Transmit-in-the  dark  calls  accurate  within  1 mile. 

4.  Respond  to  "Contact"/"Judy"/"Lost  Contact"  calls  within  5 
seconds,  100  percent  of  the  time. 

5.  Stranger  information  prior  to  10  miles  from  CAP  100  percent 
of  the  time,  accurate  ±5  degrees  and  ±2  miles. 

6.  Locate  aircraft  using  IFF  and  TACAN  within  1 minute  after 
communications  established,  100  percent  of  the  time. 

7.  Transmit  headings  for  training  set  ups  within  ±10  degrees, 

100  percent  of  the  time. 

8.  Transmit  headings  for  area  control  to  remain  in  assigned  area, 
100  percent  of  the  time. 

TABLE  13.  STEPS  REQUIRED  FOR  MASTERY  OF  LEVEL  12. 

Step  1.  Rough  control  within  assigned  area. 

Step  2.  Precise  control  to  a designated  point. 

Step  3.  Intercept  point  determination. 

Step  4.  Breakaway  heading  selection. 

Step  5.  "Live"  bogey  intercept. 

Step  6.  Control  of  bogey  and  fighter. 
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requires  these  skills  to  be  employed.  Performance  on  each  will  be  meas- 
ured, and  remedial  tasks  will  be  suggested  upon  failure  at  any  one  of  them: 

Step  1:  Rough  Control  Within  Assigned  Area  — at  this  step  the  student  will 
control  one  aircraft.  The  radar  display  will  be  marked  to  show  an  area 
to  which  he  is  to  vector  the  aircraft  (once  he  has  identified  it)  and  hot  areas. 

The  problem  will  be  to  vector  the  aircraft  into  the  area  and  keep  it  within 
the  area.  Hot  areas,  traffic,  etc.  must  be  avoided.  The  student  will  be 
given  practice  with  aircraft  flying  at  different  speeds  and  altitudes  and 
making  turns  at  various  rates. 

Step  2:  Precise  Control  to  Designated  Point  — for  this  task,  the  student  j 

will  be  required  to  vector  his  aircraft  in  such  a way  that  is  passes  through  i 

a specified  point  marked  on  the  radar  display.  Again  a variety  of  problems  | 

will  be  provided  so  that  the  student  can  become  proficient  at  precise  air- 
craft control.  I 

Step  3:  Intercept  Point  Determination  — this  task  introduces  the  intercept 
problem.  The  student  will  be  required  to  determine  the  best  intercept  point 
given  the  geometry  of  the  tactical  situation.  He  will  convey  his  choice  to 

the  system  by  ball-tab  on  light  pen  entry  and  will  be  given  immediate  feed-  ^ 

back  in  the  form  of  a track  display  of  both  interceptor  and  bogey  to  the 
system  selected  intercept  point. 

Step  4;  Breakaway  Heading  Selection  — intercept  geometry  will  be  dis- 
played and  the  student  will  be  required  to  compute  and  send  the  breakaway 
heading.  Enough  examples  will  be  provided  to  allow  proficiency  to  develop. 

The  Step  3 and  Step  4 tasks  might  best  be  intermixed  for  variety.  Neither 
depends  upon  the  other  and  practicing  them  one  at  a time  might  induce 
boredom. 

Step  5:  "Live"  Bogey  — at  this  step,  a live  bogey  will  be  introduced. 

The  student  will  have  developed  all  the  skills  needed  to  marshal  the  inter- 
cept. He  will  be:  capable  of  directing  the  interceptor  to  a point  he  chooses; 
capable  of  choosing  a good  intercept  point;  and  able  to  given  breakaway  in- 
structions. As  he  becomes  proficient,  the  problems  will  become  more 
difficult.  Jinking  bogeys,  jamming,  loss  of  the  program,  etc,  all  may  be 
.siinul.iti'd. 

Step  6:  Control  of  both  Bogey  and  Fighter  — one  of  the  AIC's  tasks  is 
to  coordinate  safe  practice  setups  for  student  pilots.  He  will  acquire  this 
skill  during  this  final  step  in  level  12. 

Variables  - Within  each  step,  a number  of  problems  will  be  provided. 

For  example,  the  first  few  problems  in  Step  5 may  consist  of  only  fighter 
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and  bogey  with  no  drift,  no  jinks,  no  traffic  etc.  in  order  to  facilitate  con- 
cept acquisition.  As  concept  mastery  is  achieved,  further  practice  will 
emphasize  its  application  in  a more  realistic  and  complex  environment,  in- 
cluding the  simulation  of  the  "in-the-dark”  condition.  Table  14  shows  the 
list  of  the  types  of  variables  available  for  problem  setup,  and  the  steps  in 
which  they  can  be  used. 

Performance  Measurement  — The  previous  paragraph  demonstrated 
that  a syllabus  of  training  problems  could  be  devised  for  the  AIC  training 
system.  A relatively  small  number  of  parameters  can  be  varied  to  provide 
a large  number  of  different  training  experiences.  Performance  on  each 
aspect  of  the  problem  can  be  measured  objectively  and  output  to  the  in- 
structor. In  addition,  the  combined  results  can  serve  as  the  criterion  for 
the  automatic  selection  of  the  next  training  problem. 

A preliminary  set  of  performance  measurement  variables  has  been 
extracted  from  the  current  set  of  training  lessons  which  would  support  level 
12  training.  It  is  shown  in  table  15.  Notice  that  the  level  12  completion 
requirements  shown  in  table  12  can  be  expressed  in  terms  of  specified  levels 
of  performance  on  selected  performance  measurement  variables.  The 


TABLE  14.  VARIABLES  AVAILABLE  AT  PROBLEM  SETUP,  LEVEL  12. 


Variables 


Applicable  Steps 


Location  of  play  area  1,  2,  6 

Location  of  hot  areas  All 

Number  of  aircraft  responding  to  AIC  control 

Number  of  tracks  All 

Types  of  tracks  All 

Drift  All 

Track  starting  point  All 

AOB,  speed,  altitude,  etc.  All 

In  the  dark  1,  2,  5,  6 

Jink  5 

Weapons  5,  6 

Lost  communications  1,  2,  5,  6 

Jamming  5,  6 


TABLE  15.  PRELIMINARY  SET  OF  PERFORMANCE  MEASUREMENT  VARIABLES. 
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Transmit  altitude  5,  6 At  voice  Correct  transmis- 

with  program  aid  transmission  sion  within  1.  5 

minutes  of  target 
detection  till  Jvidy: 
Pass 


TABLE  15.  PRELIMINARY  SET  OF  PERFORMANCE  MEASUREMENT  VARIABLES  (Cont). 


13.  Vector  to  play  area  1,6  30  seconds  Arrival  in  play 

after  locating  area;  Pass 


TABLE  15.  PRELIMINARY  SET  OF  PERFORMANCE  MEASUREMENT  VARIABLES  (Cont). 
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advantage  of  describing  the  training  problem  in  this  way  is  that  separate 
modules  can  be  defined  for  each  performance  measurement  variable  and 
can  be  called  into  operation  as  needed  in  the  real-time  environment. 

Conclusion  — This  brief  description  of  a laboratory  version  of  an  AIC 
training  system  focused  on  the  requirements  for  level  12  training.  It  gives 
an  idea  of  the  types  of  training  which  could  be  studied  if  the  training  system 
were  divorced  from  NTDS  and  the  UYA-4  console.  The  system  would  have 
limited  usefulness  in  an  actual  training  environment  because  of  the  fact  that 
it  does  not  provide  for  motor  skill  development.  These  drawbacks  must  be 
weighed  against  the  flexibility  such  a system  would  provide  for  syllabus 
development  and  performance  measurement  variable  definition,  and  de- 
velopment of  training  system  design  guidelines  in  general. 


Arguments  in  Favor  of  an  NTDS-Based  Prototype 

These  are  essentially  two  arguments  to  be  made  in  favor  of  using  the 
NTDS  console  in  NAVTRAEQUIPCEN' s research  program.  The  validity  of 
these  arguments  depend  in  large  measure  on  the  specific  research  objec- 
tives of  the  program. 

One  argument  depends  upon  the  depth  to  which  the  exploration  of  per- 
formance measurement  and  evaluation  features  are  to  be  studied.  Explora- 
tion of  the  greatest  range  of  AIC  training  parameters  will  require  either 
use  of  the  NTDS  console  or  a highly  realistic  (and  hence  costly)  replica  of 
all  or  part  of  the  UYA-4  characteristics.  Primary  consideration  is  the  de- 
gree to  which  cognitive -verbal  skills  take  precedence  over  motor  skills  in 
the  research  issues  of  concern  to  NAVTRAEQUIPCEN.  Unless  the  NTDS 
console  is  used,  many  of  the  direct  measures  of  performance  will  be  lost. 
Thus,  the  measurement  methodology  employed  must  be  inferential.  In  this 
case,  care  must  be  exercised  in  the  selection  of  the  tasks  to  be  measured 
for  the  sake  of  guarding  against  both  negative  transfer  and  the  later  spon- 
taneous recovery  of  motor  skills  appropriate  only  to  the  UYA-4  console. 

From  the  perspective  of  motor  skill  development,  this  issue  regarding 
utilization  of  the  NTDS  console  is  a subset  of  an  issue  raised  earlier  (the 
depth  to  which  performance  measurement  should  occur).  Many  of  the 
enabling  objectives  are  related  to  console  functions.  If  these  are  to  be 
measured,  then  use  of  the  NTDS  system,  together  with  some  form  of  data 
acquisition,  is  probably  required.  The  converse  is  not  necessarily  true, 
however. 
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The  second  argument  in  favor  of  using  the  NTDS  console  is  valid  even 
if  performance  measurement  is  limited  to  the  verbal-skill  terminal- 
objective  level,  as  discussed  in  a previous  subsection.  Recall  the  trainees 
are  normally  dropped  from  the  AIC  school  because  they  lack  the  ability  to 
manipulate  the  console;  receive  required  data  accurately;  and,  then  to  trans- 
mit this  data  to  the  aircraft  in  timely  fashion.  And  all  this  time  the  AIC  is 
keeping  track  of  at  least  two  and  often  several  aircraft,  and  receiving  and 
issuing  reports  to  the  TAO.  Any  individual  task  can  usally  be  taught;  with- 
out difficulty,  but  combine  the  tasks  in  an  operational-like  environment,  and 
the  learning  problems  develop. 

In  short,  it  is  not  enough  to  "simply"  determine  which  tasks  can  be 
automated  and  which  ones  can't,  to  solve  the  speech  recognition  problems 
and  to  develop  a computer  grader.  Rather  the  effort  must  address  the 
above  tasks  and  then  go  on  to  observe  the  trainee  in  a realistic  training  en- 
vironment and  determine  how  to  tie  together  the  system  capabilities  pre- 
viously developed.  The  R&D  effort  must  determine  how  the  training  system 
can: 

a.  Motivate  the  trainee,  show  him  that  he  can  accomplish  the  job. 

b.  Challenge  the  trainee  without  overburdening  him. 

c.  Teach  individual  skills  and  then  tie  them  together  into  a cohesive 
whole. 

d.  Recognize  that  the  standards  for  performance  are  valid  in  the 
simulated  operational  environment. 

An  Alternate  Approach 

Let's  recap  the  important  points  just  briefly: 

a.  Investigations  of  the  automated  speech  technologies  are  essentially 
independent  of  the  choice  of  trainee  console. 

b.  Performance  measurement  at  the  level  of  terminal  objectives  is 
recommended  by  the  AIC  instructors,  and  this  can  occur  for  the  most  part 
by  monitoring  only  the  student's  verbal  behavior. 

c.  Use  of  the  UYA-4  console  is  essential  if  motor  skills  are  of  inter- 
est in  NAVTRAEQUIPCEN's  research  program 
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d.  Evaluation  of  new  training  approaches  must  be  conducted  in  a 
realistic  operational  environment,  using  the  NTDS. 

With  these  points  in  mind,  and  assuming  motor  skills  are  not  of  interest 
to  NAVTRAEQUIPCEN,  a research  program  which  utilizes  both  a commer- 
cial graphic-CRT  console  with  simulated  NTDS  functions,  and  the  NTDS 
program  with  UYA-4  console,  should  be  seriously  considered  by  NAVTRA- 
EQUIPCEN. By  careful  design  of  the  software  subsystems,  it  is  entirely 
feasible  to  develop  the  ACTS  and  do  preliminary  tests,  evaluation  and 
research,  using  a graphic-CRT.  After  the  basic  systems  are  functioning, 
the  system  can  easily  be  integrated  into  an  operational-like  environment 
including  the  use  of  NTDS  and  the  UYA-4  for  system  level  evaluation.  This 
two-phase  attack  will  realize  all  the  advantages  of  both  the  non-NTDS  and 
with-NTDS  approaches.  System  development  will  be  simplified  while  at 
the  same  time  system  evaluations  will  be  meaningful  and  accurate. 

The  key  to  the  success  of  this  dual  console  approach  is  to  design  the 
software  in  such  a way  that  all  radar  simulation  and  NTDS-related  functions 
are  modularly  8ej>arated  from  the  speech  understanding,  performance 
measurement^  exercise  control,  and  aircraft  simulation  functions.  This 
can  be  done.  See  figures  12  and  13. 

The  hardware  components  of  the  early  system  development  configura- 
tion of  ACTS  would  probably  be  nearly  identical  to  the  hardware  configura- 
tion of  the  prototype  GCA-CTS.  Additional  core  and  processor  capability 
may  be  needed  to  support  ACTS  because  of  the  increased  burden  on  the 
speech  recognition  requirement. 

The  NTDS  supported  system  evaluation  configuration  of  ACTS  is  shown 
in  figure  1 5.  Notice  that  the  radar  video  is  fed  to  the  NTDS  console  through 
a Radar  System  Simulation  Unit  (RSSU).  The  RSSU  is  specifically  designed 
to  interface  with  the  NTDS  equipment  suite.  The  unit,  built  by  Logicon,  Inc. 
around  a Nova  800  computer  chassis,  provides  radar  and  IFF/SIF  videos  to 
the  NTDS  at  the  proper  ranges,  azimuths,  beamwidths,  intensities,  and 
pulse  widths  to  stimulate  the  NTDS  as  if  it  were  receiving  live  radar  and 
IFF/SIF  signals.  RSSUs  have  previously  been  used  to  provide  video  to  the 
FCTCP  mockups  on  a variety  of  occasions.  Utilization  of  the  RSSU  in  the 
ACTS  should  be  considered  a low  risk,  low  cost,  situation. 

FCTCP  personnel  have  ix^dicated  that  a UYA-4  console  and  the  other 
NTDS  support  systems  can  be  made  available  to  NAVTRAEQUIPCEN  for 
this  research  program  whenever  they  are  not  in  use  for  fleet  training 
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Figure  12.  ACTS  Development  System, 
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Figure  13.  ACTS  Evaluation  System. 
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^ exercises.  Because  of  the  convenient  "patch  panel"  at  FCTCP  and  FCDSSA, 

; this  "sharing"  arrangement  presents  no  particular  difficulties.  As  men- 

; tioned  in  section  IV  with  regard  to  the  installation  of  the  "quick-fix"hardware, 

I NAVELEX  should  be  tasked  to  support  system  integration  activities. 
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SECTION  VII 

CONCLUSIONS  AND  RECOMMENDATIONS 


Introduction 


This  study  covered  a considerable  range  of  material  which  has  been 
reflected  in  the  variety  of  topics  discussed  in  the  report.  In  order  to 
preserve  the  focus  of  the  original  statement  of  work,  this  section  will 
recapitulate  the  findings  on  a point -by -point  basis  against  that  statement  of 
work.  In  addition,  the  section  suggests  specific  action  items  and  also  a 
preliminary  program  plan  for  development  of  NAVTRAEQUIPCEN' s training/ 
research  system. 


Statement  of  Work  Tasks 


The  FCTCP  AIC  Training  Analysis  — A task  analysis  of  the  air  inter- 
cept controller  was  conducted  by  FCTCP  personnel.  The  emphasis  through 
out  that  analysis  was  in  defining  the  tasks  performed  by  the  AIC,  rather 
than  describing  the  equipment  which  he  operates.  As  such,  the  resulting 
course  was  a departure  from  the  more  traditional  AIC  training  approaches. 
The  synthetic  portion  of  the  course  is  comprised  of  thirteen  levels,  blocked 
and  sequenced  such  that  the  student  is  naturally  led  from  the  easy  to  the 
difficult,  from  the  simple  to  the  complex.  Although  the  new  course  structure 
has  been  utilized  for  only  several  months,  it  is  generally  acknowledged  to 
be  a significant  improvement  over  the  previous  methods. 

A more  complete  implementation  of  the  Instructional  Systems  Develop- 
ment (ISD)  concept  to  the  AIC  training  problem  would  proceed  from  these 
existing  task  listings  to  specify  in  greater  detail  the  conditions  associated 
with  each  terminal  objective,  and  both  the  conditions  and  standards  associ- 
ated with  each  enabling  objective.  Specification  of  the  conditions  will  docu- 
ment the  simulation  requirements  imposed  upon  both  the  present  and  future 
training  systems.  Specification  of  the  standards  will  ensure  a more  uniform 
performance  grading  system  across  all  instructors,  and  give  greater  visi- 
bility to  course  weaknesses.  Also,  as  discussed  in  section  VI,  a more  com- 
plete specification  of  the  conditions  and  standards  is  a prerequisite  to 
development  of  automated  performance  measurement,  computer  grading  and 
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adaptive  syllabus  control.  To  the  extent  that  these  features  will  be  included 
in  future  training  systems,  they  should  be  documented  in  the  formal  ISD 
sense. 

Based  upon  the  task  analysis  developed  by  FCTCP,  the  appropriate 
training  media  should  also  be  reviewed  as  part  of  the  complete  ISD  process. 
The  existing  course  (synthetic  portion)  has,  for  the  most  part,  been  struc- 
tured around  the  TACDEW  system.  Training  effectiveness  may  indeed  be 
improved  by  re-evaluating  different  presentations  and  teaching  methods  in 
light  of  the  identified  AIC  tasks. 

Finally,  it  was  determined  that  a task  analysis  has  not  been  performed 
for  the  Antisubmarine  Air  Controller  (ASAC).  While  formally  not  a part 
of  the  AIC  program,  the  ASAC  training  program  is  integrated  with  AIC 
because  of  the  similarity  in  simulation  requirements. 

The  AIC  Controller  Model  — A controller  model  was  defined  as  "a 
codable  model  of  controller  behavior.  " The  learning  objectives,  along 
with  their  associated  conditions  and  standards,  constitute  the  controller 
model  at  the  functional  level.  Branching  from  the  conclusions  of  the  pre- 
vious paragraph,  therefore,  the  AIC  controller  model  at  the  terminal 
objective  level  is  largely  defined  by  the  existing  task  listings,  except  for 
some  weaknesses  in  specification  of  relevant  conditions.  The  controller 
model  at  the  enabling  objective  level  is  largely  undefined.  Development  of 
a complete  controller  model  will  require  specification  of  a representative 
scenario  which  includes  the  stimulus  and  response  elements  associated  with 
the  AIC's  performance  of  his  responsibilities.  The  level  of  detail  of  this 
specification  will  depend  upon  the  purpose  toward  which  the  model  is  being 
developed.  As  the  vehicle  for  automated  performance  measurement,  the 
controller  model  must  be  defined  to  the  level  that  measurement  will  occur 
(e.  g.  , the  standards  associated  with  terminal  objectives).  As  the  vehicle 
for  automated  diagnostics,  the  controller  model  must  be  defined  to  the  level 
that  diagnostics  will  be  administered  (e.  g.  , the  enabling  objectives).  De- 
velopment of  the  controller  model,  therefore,  should  follow  definition  of  the 
requirements  which  necessitate  that  development. 

AIC  Vocabulary  — Many,  though  not  all,  of  the  terminal  objectives  of 
AIC  tasks  can  be  stated  in  terms  of  the  verbal  transmissions  associated 
with  these  tasks.  The  specific  AIC  phraseology  was  examined  and  found  to 
be  only  loosely  defined,  particulary  when  compared  to  the  vocabulary 
associated  with  GCA.  Moreover,  there  is  a heavy  emphasis  on  the  trans- 
mission of  numerical  data.  While  it  is  possible  to  provide  remedial  training 
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support  using  existing  isolated  word  speech  recognition  techniques  together 
with  speech  stylization,  a more  complete  AIC  training  capability  (incluuL.j 
performance  measurement)  based  on  IWR  would  be,  at  best,  marginally 
acceptable. 

A mixed  strategy  of  several  speech  recognition  techniques  were  con* 
sidered;  expanded  (30  word  vocabulary)  limited  continuous  speech  recogni- 
tion; isolated  phrase  recognition,  and  word  spotting.  These  capabilitie.,, 
together  with  some  forced  stylizations,  restrictions  as  to  personal  variations, 
and  procedural  accommodations,  should  permit  the  development  of  an  effec- 
tive speech  recognition  based  training  system. 

Near  Term  FCTCP  Support  — This  study  reviewed  the  feasibility  of 
providing  a temporary  solution  to  FCTCP's  manpower  and  training  time 
problems  through  the  use  of  an  advanced  speech  technologies  based  system. 
This  system  would  simply  replace  the  PC&E  pseudo-pilots  and  not  include 
performance  measurement  or  adaptive  syllabus  control.  As  such,  the 
vocabulary  requirement  can  be  relaxed  (to  the  extent  that  existing  isolated 
word  recognition  techniques  together  with  a clearly  defined  stylization  rule 
can  support  the  application)  with  low  technical  risk.  The  system  as  con- 
ceived would  replace  the  current  15G17  CRT  Target  Control  Subsystem. 

The  one  computer  TACDEW-MSP  and  an  appropriate  NTDS  operational 
program  would  complete  the  training  configuration. 

In  addition  to  this  "quick  fix"  system,  additional  support  for  FCTCP': 
current  AIC  training  program  was  identified.  More  exercise  scenarios 
could  be  presented  to  the  students  to  increase  the  various  learning  expe 
ences  associated  with  each  level.  Also,  the  L-TRAN  capability  could  he 
more  effectively  utilized  to  present  basic  console  related  tasks  to  the 
trainees.  Finally,  more  advanced  synthetic  exercises  could  be  doveloi 
to  augment  the  three  week  "live"  portion  of  the  course,  and  for  the  beneJ 
of  current  AIC's  who  wish  to  maintain  their  qualifications. 

The  NTEC  AIC  Research  Training  System- 

In  addition  to  the  topics  discussed  in  the  preceding  subsection  this 
report  also  addressed  the  AIC  research  training  system  being  planned  by 
NAVTRAEQUIPCEN.  Indeed,  it  is  this  system,  ACTS,  which  g.  n. 
interest  in  AIC  performance  measurement,  the  controller  mooci,  advanci  c. 
recognition  capabilities,  etc.  A guiding  assumption  throughout  this  study 
was  that  ACTS  would  serve  as  an  engineering  testbed  for  may  of  the 
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technologies  and  instiructional  features  which  would  later  be  implemented  on 
an  AIC/ASAC  trainer  scheduled  for  the  1980's.  Thus,  rather  than  being  an 
operational  trainer  as  such,  ACTS  has  been  perceived  as  a research  tool 
which  would  support  the  functional  and  design  specifications  of  the  ("real") 
AIC/ASAC  trainer.  The  functional  and  design  requirements  of  ACTS, 
therefore,  must  reflect  not  only  AlC  training  goals,  but  also  (and  just  as 
importantly)  NAVTRAEQUIPCEN' s research  goals. 

The  fact  that  both  training  and  research  requirements  will  impact  ACTS 
has  caused  interesting  trade-off  problems  in  terms  of  the  configuration  of 
ACTS.  While  details  of  the  system  must  await  a more  precise  specification 
of  functional  requirements,  it  is  suggested  that  a dual  configuration,  one  for 
system  development  and  one  for  system  evaluation,  should  be  carefully 
considered.  Unlike  the  GCA  tasks,  the  air  intercept  controller  must  con- 
stantly interact  with  a highly  sophisticated  system  (NTDS)  through  a complex 
console  (the  UYA-4).  Determining  the  influences  that  these  interactions 
cause  in  terms  of  the  characteristics  of  the  training  environment  is  seen  as 
an  important  part  of  the  ACTS  program. 

The  collection  of  AIC  tasks  which  should  be  addressed  by  ACTS  is 
similarly  impacted  by  the  dual  character  of  the  system.  Choosing  the 
research  training  scenario  at  this  time  is  putting  the  cart  before  the  horse. 

A clear  and  precise  definition  of  the  specific  goals  of  the  ACTS  program, 
particularly  in  terms  of  the  ACTS'  relationship  to  the  AIC/ASAC  trainer, 
will  provide  the  framework  around  which  meaningful  and  cost  effective 
decisions  can  be  made. 


Recommendations 

Having  concluded  this  brief  study  of  AIC  training,  four  areas  can  be 
identified  for  recommending  additional  work;  the  FCTCP  "quick-fix";  the 
ASAC  task  analysis;  AST  developments;  and  ACTS  development.  Recom- 
mendations for  each  of  these  are  discussed  in  the  following  paragraphs. 

See  figure  14. 

The  FCTCP  "Quick  Fix"  — The  EGOR  system  described  in  section  IV 
of  this  report  represents  a viable  solution  to  FCTCP's  immediate  manpower 
and  system  utilization  problems.  System  development  should  proceed  as 
soon  as  possible. 

ASAC  Task  Analysis  — A systematic  analysis  of  ASAC  tasks  is  sorely 
needed.  This  information  will  become  the  basis  for  the  functional  design 
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Figure  14.  Recommended  AIC  Activities. 


of  the  ASAC  portion  of  the  1980  trainer.  Moreover,  relevance  of  AIC 
related  research  (e.  g.  , ACTS)  to  the  ASAC  training  problem,  will  become 
clear  only  after  a ASAC  task  analysis  is  performed.  Following  the  steps 
noted  in  section  V,  figure  15  shows  a tentative  work  plan. 


NTDS  ASAC  Task  Analysis 


Begin  New  Course 


AST  Development  — A complete,  automated  and  adaptive  AIC  training 
system  cannot  be  supported  solely  by  isolated  phrase  recognition  systems. 
Further  R&D  is  required,  including: 

a.  Proceed  with  development  of  a basic  LCSR  capability  (strings  of 
digits). 

b.  Expand  the  basic  LCSR  technique  to  support  a 30  word  vocabulary. 

c.  Develop  a word  spotting  capability. 

ACTS  Development  — An  AIC  prototype  training  system  is  a proper 
stepping  stone  toward  the  AIC/ASAC  trainer,  as  well  as  a worthwhile 
research  tool  in  its  own  right.  Prior  to  formal  system  development, 
however,  a short  (approximately  3 months)  effort  should  be  commenced 
immediately  to  define  the  specific  research  and  training  objectives  of  such 
a system;  to  define  the  specific  end  products  that  such  a system  should 
yield;  and  to  clarify  and  specify  the  relationship  of  this  training/research 
system  to  the  AIC/ASAC  trainer. 

Once  the  requirements  are  established,  the  usual  development  process 
should  commence,  consisting  of  functional  specification,  design,  program- 
ming, test,  as  shown  in  figure  14. 
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